-- Logs begin at Fri 2021-11-12 14:15:26 UTC, end at Fri 2021-11-12 15:15:03 UTC. -- Nov 12 14:46:34.887586 dv-cinder-776422-5-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 12 14:46:37.637548 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.common.config [-] Logging enabled! Nov 12 14:46:37.638149 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev157 Nov 12 14:46:37.638318 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=101510) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 12 14:46:37.641495 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.common.config [-] Logging enabled! Nov 12 14:46:37.641746 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev157 Nov 12 14:46:37.642053 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=101510) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 12 14:46:37.642980 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 12 14:46:37.643212 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 12 14:46:37.643821 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 12 14:46:37.644059 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 12 14:46:37.644305 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 12 14:46:37.644618 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.645033 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 12 14:46:37.645346 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.645633 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.645919 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.646206 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.646493 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.646765 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.647046 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.647339 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.647616 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.647889 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.648190 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.648475 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.648750 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] config_source = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.649027 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.649304 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.649577 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] debug = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.649856 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.650264 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.650682 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.650958 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.651239 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.651513 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.651775 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.652044 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.652364 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.652687 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] host = dv-cinder-776422-5-iscsi {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.652961 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.653240 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.653518 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.653795 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.654062 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.654330 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.654606 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.654872 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] log_dir = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.655137 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] log_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.655405 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.655683 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.655961 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.656263 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.656480 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.656698 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.656976 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.657253 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.657527 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.657793 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.658060 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.658328 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.658597 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.658859 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.659137 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.659412 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.659688 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.659955 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.660247 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.660513 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.660779 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.661053 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.661320 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.661585 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.661851 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.662125 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.662384 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.662651 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.662941 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.663215 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.663489 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.663764 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.664029 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.664324 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.664589 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.664854 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] use_journal = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.665117 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] use_json = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.665380 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.665642 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.665914 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.666177 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.666440 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.666706 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.666967 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.667241 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:37.667536 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.668354 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.668650 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.668928 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.669224 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.669498 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.669779 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.670048 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.670325 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.670603 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.670885 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.671158 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.671439 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.671708 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.671991 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.672309 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.672595 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.672879 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.673149 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.673416 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.673682 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.673954 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.674233 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.674503 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.674782 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.675062 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.675335 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.675615 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.675900 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.676201 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.676469 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.676740 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.677022 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.677292 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.677559 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.677829 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.678106 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.678373 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.678635 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.678912 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.679182 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.679445 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.679712 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.679982 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.680296 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.680568 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.680830 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.681091 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.681360 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.681621 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.681896 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.682165 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.682430 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.682694 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.682965 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.683229 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.683560 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.684379 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.684648 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.684920 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.685187 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.685454 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.685723 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.685989 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.686255 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.686525 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.686789 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.687066 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.687336 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.687603 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.687881 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.688169 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.688442 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.688728 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.689024 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.689298 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.689574 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.689847 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.690118 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.690388 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.690661 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.690934 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.691330 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.691470 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.691756 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.692034 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.692336 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.692614 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.692886 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.693209 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.693485 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.693764 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.694037 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.694309 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.694587 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.694864 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.695151 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.695435 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.695721 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.696006 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.696318 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.696597 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.696902 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.697179 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:37.697397 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 12 14:46:37.697637 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=101510) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 12 14:46:38.128826 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=101510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 14:46:38.129097 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=101510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 14:46:38.129394 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=101510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 14:46:38.129721 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 12 14:46:38.458954 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.459239 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.459505 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.460722 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.460989 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.461248 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.496588 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.496866 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.497130 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.512857 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.513134 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.513399 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.543906 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.544214 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.544485 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.580679 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.580951 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.581217 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.818520 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.819116 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.819116 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.819258 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.819927 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.948911 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.949778 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.950065 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.950335 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.950595 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.950906 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.951161 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.951414 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.951685 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.951969 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.952251 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.952521 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.952781 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.953037 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.953295 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.953561 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.953816 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.954089 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.954362 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.954624 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.954895 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.955154 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.955434 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.955817 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.956066 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.956338 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:38.956735 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=101510) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 12 14:46:38.956973 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=101510) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 12 14:46:38.957209 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=101510) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 12 14:46:38.957445 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=101510) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 12 14:46:38.957677 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=101510) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 12 14:46:38.957911 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=101510) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 12 14:46:38.958292 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 12 14:46:38.961851 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 12 14:46:38.965867 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 12 14:46:38.969706 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(600, 649)])]) Nov 12 14:46:38.971331 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 12 14:46:38.971788 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 12 14:46:38.972132 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 12 14:46:38.972595 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 12 14:46:38.975410 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 12 14:46:38.975661 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 12 14:46:38.976010 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 12 14:46:38.981413 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 12 14:46:39.004062 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 12 14:46:39.004573 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.004874 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=101510) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 12 14:46:39.005231 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.006606 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=101510) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 12 14:46:39.006889 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 12 14:46:39.007136 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 12 14:46:39.010387 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.010671 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.075419 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 12 14:46:39.075574 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 12 14:46:39.075805 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 12 14:46:39.076210 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 12 14:46:39.096998 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_db.sqlalchemy.engines [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 14:46:39.638102 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Initializing driver for type 'gre' Nov 12 14:46:39.638559 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] gre ID ranges: [(1, 1000)] Nov 12 14:46:39.692472 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Initializing driver for type 'local' Nov 12 14:46:39.692809 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Initializing driver for type 'vlan' Nov 12 14:46:39.705816 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] VlanTypeDriver initialization complete Nov 12 14:46:39.706148 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Initializing driver for type 'vxlan' Nov 12 14:46:39.706647 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] vxlan ID ranges: [(1, 1000)] Nov 12 14:46:39.756781 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Initializing extension driver 'port_security' Nov 12 14:46:39.757118 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.extensions.port_security [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] PortSecurityExtensionDriver initialization complete Nov 12 14:46:39.757418 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Initializing mechanism driver 'openvswitch' Nov 12 14:46:39.757748 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Initializing mechanism driver 'hyperv' Nov 12 14:46:39.764383 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.plugins.ml2.plugin [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=101510) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:46:39.765224 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > port after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.765595 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > port after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.765945 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > port after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.766475 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=101510) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 12 14:46:39.766906 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > subnet after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.767273 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > subnet after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.767619 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > subnet after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.768014 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=101510) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 12 14:46:39.768710 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > network after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.769058 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > network after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.769401 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > network after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.769790 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=101510) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 12 14:46:39.770195 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > security_group after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.770541 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > security_group after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.770880 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > security_group after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.771272 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=101510) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 12 14:46:39.771676 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.772021 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.772390 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.772777 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=101510) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 12 14:46:39.773179 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > address_group after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.773523 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > address_group after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.773860 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > address_group after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.774262 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=101510) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 12 14:46:39.774641 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] ML2 OVO RPC backend initialized. {{(pid=101510) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 12 14:46:39.775374 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router_interface after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.775726 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.776164 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > network before_response 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.776554 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > networks before_response 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.776880 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > port before_response 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.778740 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > ports before_response 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.779086 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > subnet before_response 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.779427 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > subnets before_response 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.779770 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > network after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.780127 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > network after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.780461 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > network after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.780794 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > port after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.781125 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > port after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.781462 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > port after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.781809 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > subnet after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.782120 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > subnet after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.782450 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > subnet after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.783072 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.plugin [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Modular L2 Plugin initialization complete Nov 12 14:46:39.783396 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading services supported by the core plugin {{(pid=101510) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 12 14:46:39.783724 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.plugins.ml2.managers [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Got port-security extension from driver 'port_security' Nov 12 14:46:39.784209 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.extensions.vlantransparent [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Disabled vlantransparent extension. Nov 12 14:46:39.784856 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=101510) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 12 14:46:39.785074 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading Plugin: router Nov 12 14:46:39.822132 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router_interface before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.822784 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router after_create 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.822877 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router before_create 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.823225 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.823598 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.823956 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router after_delete 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.824343 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > floatingip after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.824828 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > floatingip after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.825198 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router after_create 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.825551 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router after_update 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.825906 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router after_update 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.826259 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.826623 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router after_update 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.827040 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router precommit_update 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.827411 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: port after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.827749 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: port after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.828083 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: subnet after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.828456 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.828801 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > port precommit_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.829150 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router precommit_create 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.829494 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: port before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.829836 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router precommit_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.830202 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router after_update 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.830547 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router precommit_delete 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.830899 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router precommit_create 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.831272 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router_interface after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.831618 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router precommit_update 55549900 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.831990 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > agent after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.832374 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > agent after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.832721 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > network after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.833607 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Tracking information for resource: router configured {{(pid=101510) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 12 14:46:39.833933 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Tracking information for resource: floatingip configured {{(pid=101510) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 12 14:46:39.839107 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.db.l3_agentschedulers_db [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 12 14:46:39.840424 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: port after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.840608 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: port after_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.840955 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: port after_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.841301 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: port after_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.842118 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router before_create 55550100 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.842480 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router precommit_delete 55550100 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.842837 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router precommit_create 55550100 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.843186 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > router precommit_update 55550100 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.848235 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.services.provider_configuration [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service providers = [] {{(pid=101510) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 12 14:46:39.848603 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.db.servicetype_db [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=101510) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 12 14:46:39.851661 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.services.service_base [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=101510) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 12 14:46:39.852046 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.services.service_base [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=101510) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 12 14:46:39.852411 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.services.service_base [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=101510) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 12 14:46:39.853316 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.services.service_base [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=101510) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 12 14:46:39.853690 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.services.service_base [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 12 14:46:39.854079 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=101510) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 12 14:46:39.854396 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 12 14:46:39.867715 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=101510) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 12 14:46:39.868047 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading Plugin: auto_allocate Nov 12 14:46:39.874045 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: network precommit_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.874416 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: network precommit_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.874948 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=101510) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 12 14:46:39.875269 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading Plugin: tag Nov 12 14:46:39.882239 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=101510) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 12 14:46:39.882570 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading Plugin: timestamp Nov 12 14:46:39.887012 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=101510) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 12 14:46:39.887343 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading Plugin: network_ip_availability Nov 12 14:46:39.893034 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.893600 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.893952 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:39.894696 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=101510) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 12 14:46:39.895014 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading Plugin: flavors Nov 12 14:46:39.900199 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=101510) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 12 14:46:39.900529 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading Plugin: revisions Nov 12 14:46:39.905576 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=101510) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 12 14:46:39.905973 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_concurrency.lockutils [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.776s {{(pid=101510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 14:46:39.906753 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=101510) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 12 14:46:39.907089 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Initializing extension manager. Nov 12 14:46:39.907606 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: __init__.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.907948 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: __pycache__ {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.908310 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.908644 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: address_group.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.909447 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.910033 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: address-group Nov 12 14:46:39.910359 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: address_scope.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.911080 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.911588 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: address-scope Nov 12 14:46:39.911913 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: admin_state_down_before_update.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.912951 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.913466 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: router-admin-state-down-before-update Nov 12 14:46:39.913786 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: agent.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.914500 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.915003 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: agent Nov 12 14:46:39.915322 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: agent_resources_synced.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.916314 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.916822 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: agent-resources-synced Nov 12 14:46:39.917141 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: allowedaddresspairs.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.919048 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.919574 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: allowed-address-pairs Nov 12 14:46:39.919895 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: auto_allocated_topology.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.921057 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.921567 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: auto-allocated-topology Nov 12 14:46:39.921895 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: availability_zone.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.922604 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.923111 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: availability_zone Nov 12 14:46:39.923430 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: availability_zone_filter.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.924399 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.925021 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: availability_zone_filter Nov 12 14:46:39.925343 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: data_plane_status.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.926275 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.926836 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension data-plane-status not supported by any of loaded plugins Nov 12 14:46:39.927091 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: default_subnetpools.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.928052 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.928590 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: default-subnetpools Nov 12 14:46:39.928901 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: dhcpagentscheduler.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.929749 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.930252 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: dhcp_agent_scheduler Nov 12 14:46:39.930575 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: dns.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.931522 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.932032 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension dns-integration not supported by any of loaded plugins Nov 12 14:46:39.932392 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: dns_domain_ports.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.933361 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.933858 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 12 14:46:39.934186 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.935120 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.935623 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 12 14:46:39.935943 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: dvr.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.936652 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.937155 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: dvr Nov 12 14:46:39.937728 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: ecmp_routes.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.938461 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.938953 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 12 14:46:39.939338 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: empty_string_filtering.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.940428 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.941117 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: empty-string-filtering Nov 12 14:46:39.941230 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.942223 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.942657 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 12 14:46:39.946863 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.946863 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.946863 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 12 14:46:39.946863 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: external_net.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.946863 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.946863 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: external-net Nov 12 14:46:39.950428 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: extra_dhcp_opt.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.950428 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.950428 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: extra_dhcp_opt Nov 12 14:46:39.950428 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: extraroute.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.950428 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.950428 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: extraroute Nov 12 14:46:39.950906 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: extraroute_atomic.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.951452 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.952101 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: extraroute-atomic Nov 12 14:46:39.952394 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: filter_validation.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.953337 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.953842 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: filter-validation Nov 12 14:46:39.954159 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: fip_pf_description.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.955102 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.955598 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 12 14:46:39.955917 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: fip_port_details.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.956870 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.957369 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: fip-port-details Nov 12 14:46:39.957707 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: flavors.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.958966 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.959510 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: flavors Nov 12 14:46:39.959803 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.961524 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.962032 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 12 14:46:39.962368 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: floatingip_pools.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.963077 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.963581 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: floatingip-pools Nov 12 14:46:39.963900 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: ip_allocation.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.965437 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.965932 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension ip_allocation not supported by any of loaded plugins Nov 12 14:46:39.966254 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.967191 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.967693 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: ip-substring-filtering Nov 12 14:46:39.968016 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: l2_adjacency.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.968977 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.969474 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 12 14:46:39.969796 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: l3.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.970870 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.971383 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: router Nov 12 14:46:39.971705 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: l3_conntrack_helper.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.974043 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.974567 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 12 14:46:39.974893 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.975835 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.976398 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: ext-gw-mode Nov 12 14:46:39.976724 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.977701 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.978213 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: l3-ha Nov 12 14:46:39.978542 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: l3_flavors.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.979464 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.979979 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: l3-flavors Nov 12 14:46:39.980333 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.981283 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.981792 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 12 14:46:39.982112 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: l3agentscheduler.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.983201 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.983710 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: l3_agent_scheduler Nov 12 14:46:39.984036 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: logging.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.985615 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.986129 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension logging not supported by any of loaded plugins Nov 12 14:46:39.986456 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: metering.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.987208 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.987783 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: metering Nov 12 14:46:39.988145 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.989408 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.989926 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: metering_source_and_destination_fields Nov 12 14:46:39.990250 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: multiprovidernet.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.991189 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.991697 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: multi-provider Nov 12 14:46:39.992017 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: netmtu.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.992982 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.993489 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: net-mtu Nov 12 14:46:39.993808 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: netmtu_writable.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.994730 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.995235 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: net-mtu-writable Nov 12 14:46:39.995557 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: network_availability_zone.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.996303 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.996810 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: network_availability_zone Nov 12 14:46:39.997129 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: network_ip_availability.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.998283 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:39.998794 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: network-ip-availability Nov 12 14:46:39.999115 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: network_segment_range.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:39.999924 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.000447 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension network-segment-range not supported by any of loaded plugins Nov 12 14:46:40.000770 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: pagination.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.001775 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.002102 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: pagination Nov 12 14:46:40.002426 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: port_device_profile.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.003336 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.003846 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: port-device-profile Nov 12 14:46:40.004194 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.005129 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.005638 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: port-mac-address-regenerate Nov 12 14:46:40.005958 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.006884 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.007391 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: port-numa-affinity-policy Nov 12 14:46:40.007713 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: port_resource_request.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.008668 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.009176 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension port-resource-request not supported by any of loaded plugins Nov 12 14:46:40.009496 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: port_resource_request_groups.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.010481 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.010989 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 12 14:46:40.011310 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: portbindings.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.012830 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.013347 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: binding Nov 12 14:46:40.013668 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: portbindings_extended.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.014990 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.015505 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: binding-extended Nov 12 14:46:40.015830 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: portsecurity.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.016796 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.017305 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: port-security Nov 12 14:46:40.017626 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: project_id.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.018874 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.019200 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: project-id Nov 12 14:46:40.019519 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: providernet.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.020492 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.021001 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: provider Nov 12 14:46:40.021319 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.025034 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.025573 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos not supported by any of loaded plugins Nov 12 14:46:40.025906 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.027776 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.028320 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 12 14:46:40.028652 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.029591 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.030109 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 12 14:46:40.030434 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_default.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.031365 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.031874 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-default not supported by any of loaded plugins Nov 12 14:46:40.032225 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_fip.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.032901 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.033402 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-fip not supported by any of loaded plugins Nov 12 14:46:40.033723 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_gateway_ip.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.034661 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.035164 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 12 14:46:40.035484 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_port_network_policy.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.036429 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.036933 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 12 14:46:40.037252 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.038326 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.038831 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 12 14:46:40.039154 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_pps_rule.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.040376 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.041099 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-pps not supported by any of loaded plugins Nov 12 14:46:40.041427 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_rule_type_details.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.042367 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.042916 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 12 14:46:40.043241 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: qos_rules_alias.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.044354 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.044866 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 12 14:46:40.045191 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: quota_check_limit.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.046113 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.046623 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: quota-check-limit Nov 12 14:46:40.046948 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: quotasv2.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.047946 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.048308 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: quotas Nov 12 14:46:40.048633 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: quotasv2_detail.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.051875 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.052245 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: quota_details Nov 12 14:46:40.052584 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: rbac.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.053690 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.054231 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: rbac-policies Nov 12 14:46:40.054560 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: rbac_address_group.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.055513 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.056029 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: rbac-address-group Nov 12 14:46:40.056383 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: rbac_address_scope.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.057328 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.057842 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: rbac-address-scope Nov 12 14:46:40.058164 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: rbac_security_groups.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.059121 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.059627 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: rbac-security-groups Nov 12 14:46:40.059947 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: rbac_subnetpool.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.060907 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.061417 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: rbac-subnetpool Nov 12 14:46:40.061738 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: revisionifmatch.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.062668 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.063191 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: revision-if-match Nov 12 14:46:40.063514 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: revisions.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.064681 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.065191 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: standard-attr-revisions Nov 12 14:46:40.065513 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: router_availability_zone.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.066194 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.066701 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: router_availability_zone Nov 12 14:46:40.067020 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: routerservicetype.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.067949 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.068479 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension router-service-type not supported by any of loaded plugins Nov 12 14:46:40.068803 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.069733 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.070246 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: security-groups-normalized-cidr Nov 12 14:46:40.070567 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: security_groups_port_filtering.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.071586 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.072097 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: port-security-groups-filtering Nov 12 14:46:40.072464 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.073407 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.074453 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: security-groups-remote-address-group Nov 12 14:46:40.074779 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.075774 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.076318 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: security-groups-shared-filtering Nov 12 14:46:40.076641 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.077259 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 12 14:46:40.077604 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: securitygroup.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.087888 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.088495 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: security-group Nov 12 14:46:40.088827 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: segment.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.090236 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.090744 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension segment not supported by any of loaded plugins Nov 12 14:46:40.091065 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.092095 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.092634 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 12 14:46:40.092951 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: servicetype.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.094098 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.094621 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: service-type Nov 12 14:46:40.094947 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: sorting.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.096045 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.096388 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: sorting Nov 12 14:46:40.096712 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: standard_attr_segment.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.097649 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.098169 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 12 14:46:40.098486 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: standardattrdescription.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.099151 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.099658 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: standard-attr-description Nov 12 14:46:40.099974 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: stateful_security_group.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.100954 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.101472 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: stateful-security-group Nov 12 14:46:40.101796 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: stdattrs_common.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.102367 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 12 14:46:40.102688 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.103626 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.104151 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 12 14:46:40.104476 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: subnet_onboard.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.105601 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.106119 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: subnet_onboard Nov 12 14:46:40.106443 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.107384 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.107888 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 12 14:46:40.108239 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: subnet_service_types.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.109176 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.109683 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: subnet-service-types Nov 12 14:46:40.110003 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: subnetallocation.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.111116 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.111623 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: subnet_allocation Nov 12 14:46:40.111942 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.112639 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.113142 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: subnetpool-prefix-ops Nov 12 14:46:40.113464 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.114421 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.114923 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 12 14:46:40.115240 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: tagging.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.116371 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.116889 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: standard-attr-tag Nov 12 14:46:40.117209 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: timestamp.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.118417 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.118929 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loaded extension: standard-attr-timestamp Nov 12 14:46:40.119254 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: trunk.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.120316 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.120887 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension trunk not supported by any of loaded plugins Nov 12 14:46:40.121217 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: trunk_details.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.122139 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.122652 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension trunk-details not supported by any of loaded plugins Nov 12 14:46:40.122970 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: uplink_status_propagation.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.123922 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.124458 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 12 14:46:40.124785 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Loading extension file: vlantransparent.py {{(pid=101510) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 12 14:46:40.125469 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=101510) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 12 14:46:40.125974 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 12 14:46:40.128582 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:network Nov 12 14:46:40.129115 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:subnet Nov 12 14:46:40.129511 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:subnetpool Nov 12 14:46:40.129898 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:port Nov 12 14:46:40.131218 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.131663 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service FLAVORS assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.132315 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.132751 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.133079 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:router Nov 12 14:46:40.133527 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:floatingip Nov 12 14:46:40.134123 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service METERING assigned prefix: /metering {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.135650 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:40.135989 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:40.136895 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=101510) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:46:40.137921 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of CountableResource for resource:rbac_policy Nov 12 14:46:40.138362 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:security_group Nov 12 14:46:40.138797 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 12 14:46:40.139407 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service CORE assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.139748 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:subnetpool Nov 12 14:46:40.140096 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] subnetpool is already registered Nov 12 14:46:40.140544 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service CORE assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.140860 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:subnetpool Nov 12 14:46:40.141189 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] subnetpool is already registered Nov 12 14:46:40.143865 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.144290 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service FLAVORS assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.144920 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.145360 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.145689 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:router Nov 12 14:46:40.146022 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] router is already registered Nov 12 14:46:40.146445 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:floatingip Nov 12 14:46:40.146776 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] floatingip is already registered Nov 12 14:46:40.147246 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service METERING assigned prefix: /metering {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.147948 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of CountableResource for resource:rbac_policy Nov 12 14:46:40.148302 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] rbac_policy is already registered Nov 12 14:46:40.148722 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:security_group Nov 12 14:46:40.149070 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] security_group is already registered Nov 12 14:46:40.149469 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 12 14:46:40.149798 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] security_group_rule is already registered Nov 12 14:46:40.150286 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service CORE assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.150605 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:subnetpool Nov 12 14:46:40.150930 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] subnetpool is already registered Nov 12 14:46:40.151348 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.v2.resource_helper [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Service CORE assigned prefix: {{(pid=101510) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 12 14:46:40.151666 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Creating instance of TrackedResource for resource:subnetpool Nov 12 14:46:40.152069 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING neutron.quota.resource_registry [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] subnetpool is already registered Nov 12 14:46:40.154427 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: extensions {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.155951 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: address-groups {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.157475 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: address-scopes {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.158689 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: agents {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.159950 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: auto-allocated-topology {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.161240 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: availability_zones {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.162450 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: dhcp-networks {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.163931 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: dhcp-agents {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.165500 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: routers {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.167629 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: flavors {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.168939 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: service_profiles {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.170144 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: next_providers {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.171578 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: service_profiles {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.173034 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: floatingip-pools {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.174385 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: routers {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.176533 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: floatingips {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.177845 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: l3-routers {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.179278 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: l3-agents {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.180709 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: metering-labels {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.181955 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: metering-label-rules {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.183377 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: network-ip-availabilities {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.184716 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: bindings {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.186290 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: quotas {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.187947 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: quotas {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.189509 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: rbac-policies {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.190703 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: security-groups {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.192019 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: security-group-rules {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.193282 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: service-providers {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.194499 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: subnetpools {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.195892 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: subnetpools {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.197409 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.199620 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.201500 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.203288 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.205041 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.206981 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.208715 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.211640 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.213455 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.215825 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron.api.extensions [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Extended resource: tags {{(pid=101510) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 12 14:46:40.222080 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING keystonemiddleware.auth_token [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 12 14:46:40.226821 dv-cinder-776422-5-iscsi neutron-server[101510]: WARNING keystonemiddleware.auth_token [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 12 14:46:40.235933 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_concurrency.lockutils [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Acquired lock "singleton_lock" {{(pid=101510) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 12 14:46:40.236429 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_concurrency.lockutils [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Releasing lock "singleton_lock" {{(pid=101510) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 12 14:46:40.237082 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO oslo_service.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Starting 2 workers Nov 12 14:46:40.241928 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Started child 101617 {{(pid=101510) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 12 14:46:40.247059 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Started child 101618 {{(pid=101510) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 12 14:46:40.247958 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:40.248660 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO neutron.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 12 14:46:40.249292 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Publish callbacks [] for process, before_spawn {{(pid=101510) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:40.249619 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [-] (101617) wsgi starting up on http://0.0.0.0:9696 Nov 12 14:46:40.251675 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO oslo_service.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Starting 1 workers Nov 12 14:46:40.251799 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:40.253161 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [-] (101618) wsgi starting up on http://0.0.0.0:9696 Nov 12 14:46:40.256927 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Started child 101619 {{(pid=101510) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 12 14:46:40.257468 dv-cinder-776422-5-iscsi neutron-server[101510]: INFO oslo_service.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Starting 1 workers Nov 12 14:46:40.260672 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] calling RpcWorker wait() {{(pid=101619) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 12 14:46:40.261225 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] returning from RpcWorker wait() {{(pid=101619) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 12 14:46:40.262536 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Started child 101620 {{(pid=101510) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 12 14:46:40.263123 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:40.263341 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG neutron_lib.callbacks.manager [None req-e4f5f3eb-0d1a-43ea-8ddf-3417cb392e85 None None] Publish callbacks [] for process, after_spawn {{(pid=101510) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:40.263719 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:46:40.265322 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=101510) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 12 14:46:40.265537 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 12 14:46:40.265722 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 12 14:46:40.265936 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 12 14:46:40.266265 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 12 14:46:40.266442 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 12 14:46:40.266973 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.267247 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.267390 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:40.267912 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.267912 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.268087 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.268827 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.269065 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.269310 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.269577 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.269837 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.270002 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.270164 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.270403 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.270634 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.270913 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.271175 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.271426 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.271675 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.271841 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.272131 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] config_source = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.272396 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.272639 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.272908 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] debug = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.273160 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.273617 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.273844 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.274080 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.274298 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.274588 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.274813 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.275072 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.275310 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.275526 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.275778 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.276025 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.276287 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.276524 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.276744 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.276989 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.277233 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.277455 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.277912 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] host = dv-cinder-776422-5-iscsi {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.278133 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.278345 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.278569 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.278819 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.279072 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.279286 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.279540 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.279787 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.280024 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.280269 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.280505 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.280760 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.280998 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_dir = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.281233 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.281379 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_options = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.281652 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.281915 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.282174 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.282372 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.282529 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.282720 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.282954 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.283185 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.283363 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.283543 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.283752 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.283969 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.284209 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.284444 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.284704 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.284937 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.285166 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.285377 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.285619 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.285885 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.286077 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.286296 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.286536 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.286781 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.286994 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.287205 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.287455 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.287666 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.287899 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.288158 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.288397 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.288651 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.288883 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.289111 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.289389 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.289630 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.289854 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.290110 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.290359 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.290579 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.290826 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.291079 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.291293 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.291536 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.291775 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.292007 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_journal = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.292243 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_json = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.292456 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.292718 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.292961 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.293178 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.293448 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.293637 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.293928 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.294082 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.294510 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.294785 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.295110 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.295372 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.295598 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.295993 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.296251 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.296798 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.296798 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.297355 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.297576 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.297824 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.298134 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.298339 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.298621 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.298948 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.299551 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.299551 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.299887 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.300307 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.300687 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.301090 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.301502 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.301869 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.302271 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.302644 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.302796 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:46:40.303177 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.303660 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.304089 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.304512 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.61/identity {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.304922 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.305278 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.305639 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.306011 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.306392 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.306791 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.307026 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.307687 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.307687 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.307964 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.307964 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.309098 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.309098 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.309371 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.309510 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.309683 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.309932 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.310173 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.310428 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.310619 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.310854 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.311097 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.311296 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.311516 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.311752 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.311979 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.312220 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.312452 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.312667 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.312886 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.313124 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.313357 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.313602 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.313805 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.314022 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.314266 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.314471 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.314692 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.314902 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.315135 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.315356 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.315601 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.315814 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.316065 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.316696 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.316696 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.316870 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.317010 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.317125 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.317353 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.317559 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.317765 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.317988 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.318482 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.318482 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.318638 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.318783 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.318989 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.319196 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.319488 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.319795 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.320065 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.320368 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.320614 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.320868 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.321085 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.321321 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.321539 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.321764 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.321993 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.322239 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.322467 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.322721 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.322940 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.323154 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.323387 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.323618 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.323906 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.324158 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.324926 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.325136 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.325458 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.325683 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.326042 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.326325 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.326644 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.326847 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.327245 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.327685 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.327837 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.328088 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.328420 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.328684 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.328936 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.329167 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.329395 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.329655 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.329903 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.330725 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.330984 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.331211 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.331449 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.331716 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.331978 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.332230 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.332467 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.332711 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.333045 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.333349 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.333616 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.333976 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.334357 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.334509 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.334671 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.334974 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.335414 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.335414 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.335815 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.335955 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.61/identity {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.336169 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.336338 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.336565 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.336809 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.337007 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.337441 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.337441 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.337731 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.337871 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.338351 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.338351 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.338695 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.338838 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.338990 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.339350 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.339524 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.339674 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.339821 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.340067 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.340310 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.340528 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.340743 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.340989 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.341220 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.341439 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.341916 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.342166 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.342415 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.342658 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.342897 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.343127 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.343336 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.343575 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.343790 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.344000 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.344243 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.344459 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.344669 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.344878 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.345097 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.345332 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.345595 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.345838 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.346160 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.346423 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.346648 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.346925 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.347103 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.347349 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.347582 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.347814 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.348047 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.348291 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.348524 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.348790 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.349015 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.349252 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.349462 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.349687 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.349905 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.350135 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.350372 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.350597 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.350852 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.351101 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.351315 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.351559 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.351788 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.352013 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.352276 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.352509 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.352728 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.352940 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.353146 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.353370 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.353575 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.353779 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.353995 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.354228 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.354432 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.354707 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.354914 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.355146 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.355369 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.355582 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.355788 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.356019 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.356251 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.356458 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.356675 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.356888 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.357127 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.357305 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.357509 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.357713 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.357930 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.358143 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.358347 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.358644 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.358888 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.359103 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.359385 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.359650 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.360199 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.360425 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.360759 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.360997 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.361227 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.361455 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.361669 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.362785 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.362785 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.362785 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.362785 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.363416 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.363416 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.363416 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.363829 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.363969 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.364147 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.364418 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.364757 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.365019 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.365279 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.365528 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.365771 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.366075 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.366229 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.366441 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.366686 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.366919 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.367178 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.368763 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.368763 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.368763 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.368763 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.368763 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.368763 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.368763 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.369709 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.369709 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.369709 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 12 14:46:40.370109 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=101510) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 12 14:46:40.370109 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 12 14:46:40.370109 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 12 14:46:40.370514 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 12 14:46:40.370514 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 12 14:46:40.370514 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 12 14:46:40.371597 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.371597 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.371597 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.371988 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.371988 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.371988 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.372423 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.372423 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.372423 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.372838 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.372838 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.372838 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.373227 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.373227 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.373488 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.373488 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.373749 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.373749 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.374096 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.374096 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] config_source = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.374096 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.374503 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.374503 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] debug = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.374777 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.374777 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.375070 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.375070 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.375625 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.375775 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.375913 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.376051 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.376514 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.376514 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.376514 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.376915 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.376915 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.376915 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.377424 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.377424 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.377424 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.377887 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.377887 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] host = dv-cinder-776422-5-iscsi {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.377887 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.378274 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.378274 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.378274 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.378681 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.378681 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.378681 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.379077 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.379077 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.379077 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.379414 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.379414 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.379654 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_dir = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.379654 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.379895 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_options = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.379895 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.380182 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.380313 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.380398 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.380538 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.380665 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.380797 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.380936 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.381090 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.381244 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.381398 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.381608 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.381735 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.381858 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.381980 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.382112 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.382261 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.382415 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.382571 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.382724 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.382878 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.383030 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.383188 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.383343 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.383669 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.383823 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.384134 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.384429 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.384731 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.385008 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.385301 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.385591 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.385894 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.386081 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.386215 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.386363 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.387192 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.387350 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.387511 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.387672 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.387828 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.387987 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.388161 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.388318 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.388472 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.388626 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_journal = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.388781 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_json = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.388937 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.389092 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.389246 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.389395 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.389554 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.389705 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.390012 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.390164 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 14:46:40.390344 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.390503 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.390670 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.390827 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.390982 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.391137 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.391292 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.391450 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.391598 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.391812 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.391944 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.392055 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.392242 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.392394 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.392541 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.392696 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.392852 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.393008 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.393164 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.393585 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.393742 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.393947 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.394081 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.394206 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.394348 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.394521 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.394663 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.394833 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.394988 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.395146 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.61/identity {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.395302 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.395481 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.395604 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.395755 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.395911 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.396067 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.396250 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.396405 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.396561 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.396718 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.396873 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.397029 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.397239 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.397372 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.397492 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.397626 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.397782 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.397938 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.398095 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.398252 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.398408 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.398565 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.398721 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.398878 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.399033 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.399199 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.399354 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.399509 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.399664 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.399822 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.399977 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.400148 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.400304 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.400459 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.400615 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.400772 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.400856 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:46:40.400951 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.401085 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.401241 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.401397 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.401553 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.401710 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.401869 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.402087 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.402237 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.402373 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.402506 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.402639 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.402790 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.402948 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.403098 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.403256 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.403413 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.403570 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.403727 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.403882 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.404038 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.404204 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.404366 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.404529 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.404698 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.404854 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.405003 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.405160 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.405315 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.405474 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.405630 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.405784 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.405939 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.406097 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.406252 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.406408 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.406566 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.406722 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.406877 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.407031 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.407186 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.407340 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.407494 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.407651 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.407808 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.407965 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.408133 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.408296 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.408452 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.408606 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.408770 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.408925 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.409083 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.409223 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.409390 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.409556 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.409712 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.409868 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.410022 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.410178 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.410334 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.410489 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.410645 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.410801 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.410957 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.411111 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.411273 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.411442 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.411607 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.412338 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.413368 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.413368 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.413368 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.413368 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.413868 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.413868 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.413868 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.414077 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.414152 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.414766 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.414766 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.414766 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.414766 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.61/identity {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.415073 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.415073 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.415991 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.415991 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.415991 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.415991 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.415991 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.415991 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.415991 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.416685 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.416685 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.416685 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.416685 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.417145 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.417145 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.417145 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.417814 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.417814 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.417814 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.417814 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.417814 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.418234 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.418234 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.418234 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.418444 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.418522 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.418636 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.418793 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.418949 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.419106 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.419263 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.419418 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.419577 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.419733 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.419890 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.420045 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.420238 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.420367 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.420527 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.420683 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.420840 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.420995 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.421152 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.421323 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.421479 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.421635 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.421814 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.421942 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.422156 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.422246 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.422369 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.422523 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.422678 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.422833 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.422991 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.423148 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.423304 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.423459 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.423614 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.423770 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.423926 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.424081 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.424272 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.424428 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.424584 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.424740 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.424896 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.425051 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.425218 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.425379 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.425534 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.425689 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.425844 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.426001 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.426166 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.426323 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.426478 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.426634 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.426800 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.426931 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.427096 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.427508 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.427508 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.427741 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.427741 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.427885 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.427981 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.428145 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.428350 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.428522 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.428646 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.428727 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.428898 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.429054 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.429211 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.429367 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.429506 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.429666 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.429830 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.429988 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.430143 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.430306 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.430462 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.430618 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.430774 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.430941 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.431097 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.431256 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.431412 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.431567 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.431722 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.431879 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.432039 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.432228 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.432393 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.432548 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.432711 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.432875 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.433037 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.433730 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.433901 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.434067 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.434206 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.434349 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.434511 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.434665 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.434821 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.434977 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.435135 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.435286 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.435441 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.435595 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.435768 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.435898 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.436055 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.436232 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.436389 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.436544 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.436700 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.436856 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.437012 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 14:46:40.437160 dv-cinder-776422-5-iscsi neutron-server[101510]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=101510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 12 14:46:40.587077 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50672) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:46:40.595845 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [-] 10.222.0.61 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0065086 Nov 12 14:46:52.133042 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f65a70c-f670-4820-b306-72ab6898ffcb None None] get_active_networks_info from dv-cinder-776422-5-iscsi {{(pid=101619) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 12 14:46:52.195129 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f65a70c-f670-4820-b306-72ab6898ffcb None None] No non-hosted networks {{(pid=101619) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 12 14:46:52.246670 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.agentschedulers_db [None req-2f65a70c-f670-4820-b306-72ab6898ffcb None None] DHCP Agent not found on host dv-cinder-776422-5-iscsi {{(pid=101619) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 12 14:46:52.410314 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5f207638-59e7-4383-8a17-52bdd11ea2d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1753272'] for agent, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:54.483668 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-24c6b6ea-68e9-4c21-bba4-b43667930cfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1753272'] for agent, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:54.532766 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3c6a20bf-ffd9-457d-a61b-1ccf17f46cd6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:55.565643 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1753272'] for agent, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:56.931005 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1753272'] for agent, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:57.853667 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1753272'] for agent, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:46:57.855153 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.856155 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.856155 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.857367 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.857367 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.857367 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.858145 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.858668 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.859136 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.859745 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.860245 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.860701 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:46:57.861212 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-776422-5-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:46:57.870714 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-776422-5-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:46:58.298015 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50762) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:46:58.802579 dv-cinder-776422-5-iscsi neutron-server[101618]: WARNING oslo_policy.policy [None req-422409a6-5543-426e-afac-af28555bf00e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 12 14:46:58.803179 dv-cinder-776422-5-iscsi neutron-server[101618]: WARNING oslo_policy.policy [None req-422409a6-5543-426e-afac-af28555bf00e admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 12 14:46:59.040552 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [None req-422409a6-5543-426e-afac-af28555bf00e admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101618) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:46:59.042229 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-422409a6-5543-426e-afac-af28555bf00e admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7430270 Nov 12 14:47:01.590906 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 50778) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:02.031401 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.db.l3_hamode_db [None req-e881295e-749c-43e3-9f88-93eea6a67abf None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 12 14:47:02.108910 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e881295e-749c-43e3-9f88-93eea6a67abf None None] Routers set() bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:47:02.109291 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e881295e-749c-43e3-9f88-93eea6a67abf None None] Router IDs set() for agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 12 14:47:02.121236 dv-cinder-776422-5-iscsi neutron-server[101617]: WARNING oslo_policy.policy [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 12 14:47:02.121845 dv-cinder-776422-5-iscsi neutron-server[101617]: WARNING oslo_policy.policy [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 12 14:47:02.351106 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'shared': True, 'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16'], 'is_default': True}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:47:02.447875 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.policy [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=101617) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 12 14:47:02.495006 dv-cinder-776422-5-iscsi neutron-server[101617]: WARNING oslo_policy.policy [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 12 14:47:02.495388 dv-cinder-776422-5-iscsi neutron-server[101617]: WARNING oslo_policy.policy [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 12 14:47:02.504046 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.quota [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] Loaded quota_driver: . Nov 12 14:47:02.593864 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8744638906007', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8744638902338', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8744638877316', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8744638883906', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8744643714103', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8744638936910', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1404435', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1329807', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-493283', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-424591'] for rbac-policy, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:02.660922 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:02.662430 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-35d6c95d-d59e-4f62-b99e-c20f505459ef admin admin] 10.222.0.61 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 1.0694828 Nov 12 14:47:05.374470 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 50796) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:05.669976 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Request body: {'network': {'tenant_id': 'a220f551522747ae924daef8ce89528e', 'admin_state_up': True, 'name': 'private', 'project_id': 'a220f551522747ae924daef8ce89528e'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:47:05.698898 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Made reservation on behalf of a220f551522747ae924daef8ce89528e for: {'network': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:47:05.701712 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:05.718572 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:05.828818 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:05.832472 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:05.856453 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 632} {{(pid=101617) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:47:05.880820 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8744642552293', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:05.881375 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Unsubscribe: segment precommit_create {{(pid=101617) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 12 14:47:05.881881 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.segments_db [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Added segment 2c6bff88-acbf-4963-9444-340f99942e8d of type vlan for network faf50048-e9bd-4919-b550-5674938db925 Nov 12 14:47:05.888224 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f90addbb-e428-483d-96b8-921022765ef4,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:05.909510 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.909897 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.910255 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.910578 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.910895 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.911228 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.911545 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.911869 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.912224 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.912541 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.912851 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.913153 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Tracked resource versions report: Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: pushed versions: Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: { 'AddressGroup': {'1.2'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'ConntrackHelper': {'1.0'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Log': {'1.0'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Network': {'1.1'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Port': {'1.7'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'PortForwarding': {'1.2'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'QosPolicy': {'1.10'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SecurityGroup': {'1.5'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SecurityGroupRule': {'1.2'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SubPort': {'1.0'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Subnet': {'1.1'}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Trunk': {'1.1'}} Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: consumer versions: Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: { DHCP agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: L3 agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: Metadata agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: Metering agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: Open vSwitch agent@dv-cinder-776422-5-iscsi: { 'AddressGroup': '1.2', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'ConntrackHelper': '1.0', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Log': '1.0', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Network': '1.1', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Port': '1.7', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'PortForwarding': '1.2', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'QosPolicy': '1.10', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SecurityGroup': '1.5', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SecurityGroupRule': '1.2', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SubPort': '1.0', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Subnet': '1.1', Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Trunk': '1.1'}} Nov 12 14:47:05.914240 dv-cinder-776422-5-iscsi neutron-server[101617]: {{(pid=101617) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 12 14:47:06.005567 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:06.044392 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:06.045583 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:47:06.046289 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:06.105097 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7294703 Nov 12 14:47:06.147505 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be33cf54-09d3-4714-9fbf-56c32c626a68 admin admin] Pushing event updated for resources: {'Network': ['ID=faf50048-e9bd-4919-b550-5674938db925,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:06.160101 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network faf50048-e9bd-4919-b550-5674938db925 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:47:08.952750 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 50810) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:09.355504 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31539e92-b06e-4a81-8334-66c501532526 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:47:09.356928 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-31539e92-b06e-4a81-8334-66c501532526 admin admin] 10.222.0.61 "GET /v2.0/networks/faf50048-e9bd-4919-b550-5674938db925 HTTP/1.1" status: 200 len: 825 time: 0.4031918 Nov 12 14:47:09.383574 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-860d965e-a8df-4114-b4b5-3a47ef806be5 admin admin] 10.222.0.61 "GET /v2.0/subnetpools/1921802a-2e8c-4e4c-9a16-2135a375251e HTTP/1.1" status: 200 len: 734 time: 0.0198219 Nov 12 14:47:09.394295 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Request body: {'subnet': {'gateway_ip': '172.20.0.1', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'network_id': 'faf50048-e9bd-4919-b550-5674938db925', 'name': 'private-subnet', 'subnetpool_id': '1921802a-2e8c-4e4c-9a16-2135a375251e', 'ip_version': 4}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:47:09.418151 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Made reservation on behalf of a220f551522747ae924daef8ce89528e for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:47:09.420462 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Publish callbacks [] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:09.714983 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:09.784825 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Pushing event updated for resources: {'Subnet': ['ID=ce270279-445b-4401-8389-acc15325891f,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:09.786681 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Checking segment: {'id': '2c6bff88-acbf-4963-9444-340f99942e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'faf50048-e9bd-4919-b550-5674938db925'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:47:09.787074 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Network hostable DHCP agents. Network: faf50048-e9bd-4919-b550-5674938db925, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:47:09.808529 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Network faf50048-e9bd-4919-b550-5674938db925 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:47:09.824524 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, faf50048-e9bd-4919-b550-5674938db925) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:47:09.829454 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:47:09.830064 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:09.836889 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2149317b-fca4-4914-a120-d56d5acf1b71 None None] Network faf50048-e9bd-4919-b550-5674938db925 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:47:09.846904 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e7c8873e-36f1-4b77-9645-b42e160f8c6a admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4564800 Nov 12 14:47:10.213947 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-faf50048-e9bd-4919-b550-5674938db925', 'network_id': 'faf50048-e9bd-4919-b550-5674938db925', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'fixed_ips': [{'subnet_id': 'ce270279-445b-4401-8389-acc15325891f'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 14:47:10.215323 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:10.539823 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Allocated IP 172.20.0.2 (faf50048-e9bd-4919-b550-5674938db925/ce270279-445b-4401-8389-acc15325891f/f9d6e468-2dd4-4e21-8e05-d5fe046a03e7) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:47:10.745213 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:10.754040 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:10.835381 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Network faf50048-e9bd-4919-b550-5674938db925 is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:47:10.841741 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:47:10.847519 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Pushing event updated for resources: {'Port': ['ID=f9d6e468-2dd4-4e21-8e05-d5fe046a03e7,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:10.849847 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:47:10.859618 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.859994 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.860354 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.860696 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.861030 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.861360 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.861687 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.862013 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.862353 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.862680 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.863029 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.863319 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Tracked resource versions report: Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: pushed versions: Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: { 'AddressGroup': {'1.2'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'ConntrackHelper': {'1.0'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Log': {'1.0'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Network': {'1.1'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Port': {'1.7'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'PortForwarding': {'1.2'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'QosPolicy': {'1.10'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SecurityGroup': {'1.5'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SecurityGroupRule': {'1.2'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SubPort': {'1.0'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Subnet': {'1.1'}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Trunk': {'1.1'}} Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: consumer versions: Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: { DHCP agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: L3 agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: Metadata agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: Metering agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: Open vSwitch agent@dv-cinder-776422-5-iscsi: { 'AddressGroup': '1.2', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'ConntrackHelper': '1.0', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Log': '1.0', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Network': '1.1', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Port': '1.7', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'PortForwarding': '1.2', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'QosPolicy': '1.10', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SecurityGroup': '1.5', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SecurityGroupRule': '1.2', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SubPort': '1.0', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Subnet': '1.1', Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Trunk': '1.1'}} Nov 12 14:47:10.864454 dv-cinder-776422-5-iscsi neutron-server[101619]: {{(pid=101619) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 12 14:47:10.943537 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Attempting to bind port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:47:10.943941 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Attempting to bind port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '2c6bff88-acbf-4963-9444-340f99942e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'faf50048-e9bd-4919-b550-5674938db925'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:47:10.944405 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Attempting to bind port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 on network faf50048-e9bd-4919-b550-5674938db925 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:47:10.950217 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 46, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:47:10.950608 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Checking segment: {'id': '2c6bff88-acbf-4963-9444-340f99942e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'faf50048-e9bd-4919-b550-5674938db925'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:47:10.951097 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:10.951482 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Bound using segment: {'id': '2c6bff88-acbf-4963-9444-340f99942e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'faf50048-e9bd-4919-b550-5674938db925'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:47:10.951994 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Bound port: f9d6e468-2dd4-4e21-8e05-d5fe046a03e7, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2c6bff88-acbf-4963-9444-340f99942e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'faf50048-e9bd-4919-b550-5674938db925'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:47:10.952446 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:11.017256 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] For port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:47:11.021902 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] For port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=f9d6e468-2dd4-4e21-8e05-d5fe046a03e7,segment=NetworkSegment(2c6bff88-acbf-4963-9444-340f99942e8d),segment_id=2c6bff88-acbf-4963-9444-340f99942e8d)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:47:11.026185 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:11.095552 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2f4de62-f1ae-4a21-98b4-be6f346878bd None None] Pushing event updated for resources: {'Port': ['ID=f9d6e468-2dd4-4e21-8e05-d5fe046a03e7,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:12.452287 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 50818) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:12.780702 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [None req-f66a597a-831a-4c33-a1fd-8939b52c3ebd admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101617) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:47:12.781845 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f66a597a-831a-4c33-a1fd-8939b52c3ebd admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3285117 Nov 12 14:47:15.454947 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50826) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:15.875134 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [None req-d5e09455-78ec-41c9-9b1a-b3ad0b9bbfb1 admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101618) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:47:15.877439 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d5e09455-78ec-41c9-9b1a-b3ad0b9bbfb1 admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4202883 Nov 12 14:47:18.998475 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50836) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:19.339339 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': 'a220f551522747ae924daef8ce89528e'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:47:19.355162 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:47:19.405937 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.policy [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=101618) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 12 14:47:19.453304 dv-cinder-776422-5-iscsi neutron-server[101618]: WARNING oslo_policy.policy [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 12 14:47:19.453687 dv-cinder-776422-5-iscsi neutron-server[101618]: WARNING oslo_policy.policy [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 12 14:47:19.463678 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.quota [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] Loaded quota_driver: . Nov 12 14:47:19.526523 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:19.528560 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:19.684280 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:19.690683 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:19.703642 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:47:19.715111 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:19.716370 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-63eda5e1-a687-4f92-a762-d77202fa74b0 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.7154908 Nov 12 14:47:19.807754 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:19.808049 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:19.933806 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:19.973930 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=f9d6e468-2dd4-4e21-8e05-d5fe046a03e7,segment=NetworkSegment(2c6bff88-acbf-4963-9444-340f99942e8d),segment_id=2c6bff88-acbf-4963-9444-340f99942e8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:47:19.978811 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:20.031892 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=f9d6e468-2dd4-4e21-8e05-d5fe046a03e7,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:20.823394 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88c57ffa-bd27-42db-94ee-698a5e658cd8 None None] Network faf50048-e9bd-4919-b550-5674938db925 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:47:20.933470 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-17dffe62-6206-4dbc-bd5b-56d020b5070b None None] Provisioning complete for port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:20.933863 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-17dffe62-6206-4dbc-bd5b-56d020b5070b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:21.309066 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-c5334f3e-fd72-4857-b7c1-624ddc249ba1 None None] Provisioning complete for port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:21.309431 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c5334f3e-fd72-4857-b7c1-624ddc249ba1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:21.682329 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:47:21.730768 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:21.731201 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:22.058936 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6c3a455f-8835-49b5-a78a-d0df5a4f5e48 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:22.333868 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50850) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:22.698025 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [None req-fff010c6-2a44-464c-bbf0-bbff2125154e admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101618) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:47:22.699059 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-fff010c6-2a44-464c-bbf0-bbff2125154e admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3643212 Nov 12 14:47:24.484491 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7ee1d393-509e-47cc-9cb4-262d142e776c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:25.450874 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:25.507241 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50868) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:25.655779 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Request body: {'network': {'provider:network_type': 'flat', 'admin_state_up': True, 'name': 'public', 'provider:physical_network': 'physnet1', 'router:external': True, 'is_default': True}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:47:25.682232 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Made reservation on behalf of b105d23e427d4917aadff2e66652012b for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:47:25.685479 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:25.702844 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:25.826949 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:25.831370 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:25.846387 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Reserving flat network on physical network physnet1 {{(pid=101618) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 12 14:47:25.882203 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8744642552293', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:25.883337 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Unsubscribe: segment precommit_create {{(pid=101618) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 12 14:47:25.883881 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Added segment 7c3cb67f-9891-4250-9faf-30a0a52f7e95 of type flat for network bc8f81a5-42b5-4692-9e4b-bc049497e795 Nov 12 14:47:25.901788 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c297f6c-e2a2-44b4-940f-a935bb8af879,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:25.969837 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.970216 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.970586 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.971055 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.971384 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.971719 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.972044 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.972409 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.972751 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.973070 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.973382 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.973691 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Tracked resource versions report: Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: pushed versions: Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: { 'AddressGroup': {'1.2'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'ConntrackHelper': {'1.0'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Log': {'1.0'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Network': {'1.1'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Port': {'1.7'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'PortForwarding': {'1.2'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'QosPolicy': {'1.10'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SecurityGroup': {'1.5'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SecurityGroupRule': {'1.2'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SubPort': {'1.0'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Subnet': {'1.1'}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Trunk': {'1.1'}} Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: consumer versions: Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: { DHCP agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: L3 agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: Metadata agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: Metering agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: Open vSwitch agent@dv-cinder-776422-5-iscsi: { 'AddressGroup': '1.2', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'ConntrackHelper': '1.0', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Log': '1.0', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Network': '1.1', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Port': '1.7', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'PortForwarding': '1.2', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'QosPolicy': '1.10', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SecurityGroup': '1.5', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SecurityGroupRule': '1.2', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SubPort': '1.0', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Subnet': '1.1', Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Trunk': '1.1'}} Nov 12 14:47:25.974885 dv-cinder-776422-5-iscsi neutron-server[101618]: {{(pid=101618) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 12 14:47:26.050510 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:26.104725 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:26.105936 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:47:26.106756 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:26.205569 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6972625 Nov 12 14:47:26.229646 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94361070-8aae-4883-b737-b1ba73e886b3 admin admin] Pushing event updated for resources: {'Network': ['ID=bc8f81a5-42b5-4692-9e4b-bc049497e795,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:26.246182 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:47:26.847130 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:27.850410 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:28.707689 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50890) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:28.856691 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-541794e0-4991-4426-bf19-9c1200474a17 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:47:28.858087 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-541794e0-4991-4426-bf19-9c1200474a17 admin admin] 10.222.0.61 "GET /v2.0/subnets/ce270279-445b-4401-8389-acc15325891f HTTP/1.1" status: 200 len: 849 time: 0.1490664 Nov 12 14:47:29.009387 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-573aa8d4-0e69-46f6-98a1-969a3e73cdad admin admin] 10.222.0.61 "GET /v2.0/routers/0c94e502-26a1-42dd-908b-51f6bf18739f HTTP/1.1" status: 200 len: 704 time: 0.1445565 Nov 12 14:47:29.326073 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:29.652366 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Allocated IP 172.20.0.1 (faf50048-e9bd-4919-b550-5674938db925/ce270279-445b-4401-8389-acc15325891f/24b69086-b243-4c33-8a12-0d3e5885aa53) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:47:29.846607 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:29.918012 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:30.036035 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Network faf50048-e9bd-4919-b550-5674938db925 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:47:30.044384 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:47:30.058686 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:47:30.059085 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:30.062669 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Pushing event updated for resources: {'Port': ['ID=24b69086-b243-4c33-8a12-0d3e5885aa53,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:30.266655 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-fef96307-28f1-40a1-b294-dddd0ab8d7cc None None] Provisioning complete for port 24b69086-b243-4c33-8a12-0d3e5885aa53 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:30.267261 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-fef96307-28f1-40a1-b294-dddd0ab8d7cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:30.271806 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:30.302123 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-fef96307-28f1-40a1-b294-dddd0ab8d7cc None None] Port 24b69086-b243-4c33-8a12-0d3e5885aa53 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:47:30.533208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:30.537526 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:30.538268 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:30.620752 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Pushing event updated for resources: {'Port': ['ID=24b69086-b243-4c33-8a12-0d3e5885aa53,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:30.663350 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Network faf50048-e9bd-4919-b550-5674938db925 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:47:30.665250 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:47:30.863689 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Router 0c94e502-26a1-42dd-908b-51f6bf18739f is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101618) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 14:47:30.924243 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-a4298385-320b-4a84-8292-267c61c674c9 None None] Provisioning complete for port 24b69086-b243-4c33-8a12-0d3e5885aa53 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:30.924613 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-a4298385-320b-4a84-8292-267c61c674c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:30.957053 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:47:30.962639 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-a4298385-320b-4a84-8292-267c61c674c9 None None] Port 24b69086-b243-4c33-8a12-0d3e5885aa53 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:47:30.963309 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-9adb3f74-83fa-47c0-a79b-c2560609a478 admin admin] 10.222.0.61 "PUT /v2.0/routers/0c94e502-26a1-42dd-908b-51f6bf18739f/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9460955 Nov 12 14:47:30.967518 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Sync routers for ids ['0c94e502-26a1-42dd-908b-51f6bf18739f'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:47:30.981848 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Routers {'0c94e502-26a1-42dd-908b-51f6bf18739f'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:47:30.982689 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:47:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['0c94e502-26a1-42dd-908b-51f6bf18739f'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:47:31.173543 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Set router 0c94e502-26a1-42dd-908b-51f6bf18739f gateway port host: None {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:47:31.600630 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'name': 'router1', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:47:19Z', 'updated_at': '2021-11-12T14:47:30Z', 'revision_number': 2, 'project_id': 'a220f551522747ae924daef8ce89528e', 'gw_port_host': None, '_interfaces': [{'id': '24b69086-b243-4c33-8a12-0d3e5885aa53', 'name': '', 'network_id': 'faf50048-e9bd-4919-b550-5674938db925', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'mac_address': 'fa:16:3e:90:89:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ce270279-445b-4401-8389-acc15325891f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:47:29Z', 'updated_at': '2021-11-12T14:47:30Z', 'revision_number': 2, 'project_id': 'a220f551522747ae924daef8ce89528e', 'subnets': [{'id': 'ce270279-445b-4401-8389-acc15325891f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1921802a-2e8c-4e4c-9a16-2135a375251e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:47:31.651373 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Checking router: 0c94e502-26a1-42dd-908b-51f6bf18739f for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:47:31.651833 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Updating router 0c94e502-26a1-42dd-908b-51f6bf18739f port 24b69086-b243-4c33-8a12-0d3e5885aa53 binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:47:31.729808 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.225308 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.233067 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.416018 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Pushing event updated for resources: {'Port': ['ID=24b69086-b243-4c33-8a12-0d3e5885aa53,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:32.429616 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Attempting to bind port 24b69086-b243-4c33-8a12-0d3e5885aa53 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:47:32.430022 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Attempting to bind port 24b69086-b243-4c33-8a12-0d3e5885aa53 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '2c6bff88-acbf-4963-9444-340f99942e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'faf50048-e9bd-4919-b550-5674938db925'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:47:32.430462 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Attempting to bind port 24b69086-b243-4c33-8a12-0d3e5885aa53 on network faf50048-e9bd-4919-b550-5674938db925 {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:47:32.433039 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.433414 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.433749 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.434079 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.434406 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.434734 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.435053 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.435372 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.435693 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.436011 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.436355 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.436672 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Tracked resource versions report: Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: pushed versions: Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: { 'AddressGroup': {'1.2'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'ConntrackHelper': {'1.0'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Log': {'1.0'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Network': {'1.1'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Port': {'1.7'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'PortForwarding': {'1.2'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'QosPolicy': {'1.10'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SecurityGroup': {'1.5'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SecurityGroupRule': {'1.2'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SubPort': {'1.0'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Subnet': {'1.1'}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Trunk': {'1.1'}} Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: consumer versions: Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: { DHCP agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: L3 agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: Metadata agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: Metering agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: Open vSwitch agent@dv-cinder-776422-5-iscsi: { 'AddressGroup': '1.2', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'ConntrackHelper': '1.0', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Log': '1.0', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Network': '1.1', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Port': '1.7', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'PortForwarding': '1.2', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'QosPolicy': '1.10', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SecurityGroup': '1.5', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SecurityGroupRule': '1.2', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SubPort': '1.0', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Subnet': '1.1', Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Trunk': '1.1'}} Nov 12 14:47:32.437791 dv-cinder-776422-5-iscsi neutron-server[101620]: {{(pid=101620) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 12 14:47:32.444138 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 47, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:47:32.444564 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Checking segment: {'id': '2c6bff88-acbf-4963-9444-340f99942e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'faf50048-e9bd-4919-b550-5674938db925'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:47:32.445620 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.446048 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Bound using segment: {'id': '2c6bff88-acbf-4963-9444-340f99942e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'faf50048-e9bd-4919-b550-5674938db925'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:47:32.446555 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Bound port: 24b69086-b243-4c33-8a12-0d3e5885aa53, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2c6bff88-acbf-4963-9444-340f99942e8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 632, 'network_id': 'faf50048-e9bd-4919-b550-5674938db925'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:47:32.446950 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.493688 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-04fc997b-db55-4d88-a2af-9945ce1afbf3 None None] Provisioning complete for port 24b69086-b243-4c33-8a12-0d3e5885aa53 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:32.494269 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-04fc997b-db55-4d88-a2af-9945ce1afbf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.514969 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] For port 24b69086-b243-4c33-8a12-0d3e5885aa53, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:47:32.535752 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] For port 24b69086-b243-4c33-8a12-0d3e5885aa53, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=24b69086-b243-4c33-8a12-0d3e5885aa53,segment=NetworkSegment(2c6bff88-acbf-4963-9444-340f99942e8d),segment_id=2c6bff88-acbf-4963-9444-340f99942e8d)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:47:32.536684 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-04fc997b-db55-4d88-a2af-9945ce1afbf3 None None] Port 24b69086-b243-4c33-8a12-0d3e5885aa53 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:47:32.541820 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.601309 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1e816d-2c90-462d-83e1-e240af9d736a None None] Pushing event updated for resources: {'Port': ['ID=24b69086-b243-4c33-8a12-0d3e5885aa53,revision_number=4']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:32.611558 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Routers {'0c94e502-26a1-42dd-908b-51f6bf18739f'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:47:32.612195 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:47:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['0c94e502-26a1-42dd-908b-51f6bf18739f'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:47:32.711854 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] Set router 0c94e502-26a1-42dd-908b-51f6bf18739f gateway port host: None {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:47:32.761942 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-273c1b0b-3666-48dc-b4ab-b60537205f50 None None] Provisioning complete for port 24b69086-b243-4c33-8a12-0d3e5885aa53 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:32.762643 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-273c1b0b-3666-48dc-b4ab-b60537205f50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.853347 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-273c1b0b-3666-48dc-b4ab-b60537205f50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.886692 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-273c1b0b-3666-48dc-b4ab-b60537205f50 None None] For port 24b69086-b243-4c33-8a12-0d3e5885aa53, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=24b69086-b243-4c33-8a12-0d3e5885aa53,segment=NetworkSegment(2c6bff88-acbf-4963-9444-340f99942e8d),segment_id=2c6bff88-acbf-4963-9444-340f99942e8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:47:32.891865 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-273c1b0b-3666-48dc-b4ab-b60537205f50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:32.931941 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'name': 'router1', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:47:19Z', 'updated_at': '2021-11-12T14:47:30Z', 'revision_number': 2, 'project_id': 'a220f551522747ae924daef8ce89528e', 'gw_port_host': None, '_interfaces': [{'id': '24b69086-b243-4c33-8a12-0d3e5885aa53', 'name': '', 'network_id': 'faf50048-e9bd-4919-b550-5674938db925', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'mac_address': 'fa:16:3e:90:89:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ce270279-445b-4401-8389-acc15325891f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:47:29Z', 'updated_at': '2021-11-12T14:47:32Z', 'revision_number': 4, 'project_id': 'a220f551522747ae924daef8ce89528e', 'subnets': [{'id': 'ce270279-445b-4401-8389-acc15325891f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1921802a-2e8c-4e4c-9a16-2135a375251e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:47:32.948920 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-273c1b0b-3666-48dc-b4ab-b60537205f50 None None] Pushing event updated for resources: {'Port': ['ID=24b69086-b243-4c33-8a12-0d3e5885aa53,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:32.960153 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52408509-7a41-4451-9396-e5810784ebd6 None None] The sync data for ids ['0c94e502-26a1-42dd-908b-51f6bf18739f'] in dv-cinder-776422-5-iscsi is: [{'id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'name': 'router1', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:47:19Z', 'updated_at': '2021-11-12T14:47:30Z', 'revision_number': 2, 'project_id': 'a220f551522747ae924daef8ce89528e', 'gw_port_host': None, '_interfaces': [{'id': '24b69086-b243-4c33-8a12-0d3e5885aa53', 'name': '', 'network_id': 'faf50048-e9bd-4919-b550-5674938db925', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'mac_address': 'fa:16:3e:90:89:83', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ce270279-445b-4401-8389-acc15325891f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:47:29Z', 'updated_at': '2021-11-12T14:47:32Z', 'revision_number': 4, 'project_id': 'a220f551522747ae924daef8ce89528e', 'subnets': [{'id': 'ce270279-445b-4401-8389-acc15325891f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1921802a-2e8c-4e4c-9a16-2135a375251e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:47:33.359477 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50900) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:33.482661 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-303168bd-6185-49b5-bd9f-14077d297abb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:47:33.484099 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-303168bd-6185-49b5-bd9f-14077d297abb admin admin] 10.222.0.61 "GET /v2.0/networks/bc8f81a5-42b5-4692-9e4b-bc049497e795 HTTP/1.1" status: 200 len: 842 time: 0.1236684 Nov 12 14:47:33.494931 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Request body: {'subnet': {'ip_version': 4, 'enable_dhcp': False, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'name': 'public-subnet', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:47:33.523505 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Made reservation on behalf of b105d23e427d4917aadff2e66652012b for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:47:33.526253 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Publish callbacks [] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:33.836264 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.objects.ports [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=101618) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 12 14:47:33.836679 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:33.891975 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Pushing event updated for resources: {'Subnet': ['ID=f1d69314-a0d5-4375-876e-6ed7c4b8fa75,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:33.901737 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:47:33.902101 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Network hostable DHCP agents. Network: bc8f81a5-42b5-4692-9e4b-bc049497e795, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:47:33.922486 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:47:33.936308 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, bc8f81a5-42b5-4692-9e4b-bc049497e795) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:47:33.940154 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:47:33.940759 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:33.948696 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06d73aff-78a3-42ec-996d-5cb1b205b5b0 None None] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:47:33.964202 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-bc641b89-9063-40e4-8ecb-ee3b8b24b34c admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4670200 Nov 12 14:47:34.083620 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5510424-1713-415b-a81e-12aca5cb039c None None] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:47:36.434241 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50908) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:36.577516 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-fff2344e-6b13-469e-9dbc-84638e88ae16 admin admin] 10.222.0.61 "GET /v2.0/routers/0c94e502-26a1-42dd-908b-51f6bf18739f HTTP/1.1" status: 200 len: 710 time: 0.1420488 Nov 12 14:47:36.684090 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f2c4a4c-af54-4874-9aa3-ba70e7708c47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:47:36.685560 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-4f2c4a4c-af54-4874-9aa3-ba70e7708c47 admin admin] 10.222.0.61 "GET /v2.0/networks/bc8f81a5-42b5-4692-9e4b-bc049497e795 HTTP/1.1" status: 200 len: 886 time: 0.1001883 Nov 12 14:47:36.698072 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:47:37.040646 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:37.282952 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:37.359725 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:37.466150 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Allocated IP 172.27.3.209 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:47:37.581178 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:37.616740 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:37.659765 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:47:37.666010 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:47:37.668132 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Pushing event updated for resources: {'Port': ['ID=bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:37.680601 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:47:37.945491 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:38.146088 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1760074', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1755180', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-39772'] for router, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:38.150068 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1760067', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1760184', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1755173'] for router, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:38.261565 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Router 0c94e502-26a1-42dd-908b-51f6bf18739f has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 14:47:38.452945 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:47:38.458224 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:38.459415 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-a8217e54-df95-4286-b0ed-93c2b5373135 admin admin] 10.222.0.61 "PUT /v2.0/routers/0c94e502-26a1-42dd-908b-51f6bf18739f HTTP/1.1" status: 200 len: 890 time: 1.7657194 Nov 12 14:47:39.742166 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 24b69086-b243-4c33-8a12-0d3e5885aa53 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:47:39.808399 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 24b69086-b243-4c33-8a12-0d3e5885aa53 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:39.808722 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:40.027380 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Sync routers for ids ['0c94e502-26a1-42dd-908b-51f6bf18739f'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:47:40.039640 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Routers {'0c94e502-26a1-42dd-908b-51f6bf18739f'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:47:40.040443 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:47:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['0c94e502-26a1-42dd-908b-51f6bf18739f'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:47:40.335123 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Set router 0c94e502-26a1-42dd-908b-51f6bf18739f gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:47:40.856049 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'name': 'router1', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:47:19Z', 'updated_at': '2021-11-12T14:47:37Z', 'revision_number': 4, 'project_id': 'a220f551522747ae924daef8ce89528e', 'gw_port': {'id': 'bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:a2:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:47:37Z', 'updated_at': '2021-11-12T14:47:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '24b69086-b243-4c33-8a12-0d3e5885aa53', 'name': '', 'network_id': 'faf50048-e9bd-4919-b550-5674938db925', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'mac_address': 'fa:16:3e:90:89:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ce270279-445b-4401-8389-acc15325891f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:47:29Z', 'updated_at': '2021-11-12T14:47:32Z', 'revision_number': 5, 'project_id': 'a220f551522747ae924daef8ce89528e', 'subnets': [{'id': 'ce270279-445b-4401-8389-acc15325891f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1921802a-2e8c-4e4c-9a16-2135a375251e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:47:40.910155 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Checking router: 0c94e502-26a1-42dd-908b-51f6bf18739f for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:47:40.910510 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Updating router 0c94e502-26a1-42dd-908b-51f6bf18739f port bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:47:40.961194 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:41.049838 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 50922) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:47:41.198193 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-bf3d2de3-c806-457e-b957-caaaf544753b admin admin] 10.222.0.61 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1469026 Nov 12 14:47:41.374644 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:41.383945 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:41.466884 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdaaf064-390d-481a-ab93-86796330c145 None None] Pushing event updated for resources: {'Port': ['ID=bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:41.471829 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Attempting to bind port bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:47:41.472228 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Attempting to bind port bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:47:41.472599 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Attempting to bind port bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:47:41.478701 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 47, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:47:41.479080 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:47:41.479493 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:41.479892 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:47:41.480413 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Bound port: bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:47:41.480814 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:41.537028 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] For port bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:47:41.541540 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] For port bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:47:41.546904 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:41.597661 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Routers {'0c94e502-26a1-42dd-908b-51f6bf18739f'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:47:41.598302 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:47:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['0c94e502-26a1-42dd-908b-51f6bf18739f'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:47:41.661850 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdaaf064-390d-481a-ab93-86796330c145 None None] Pushing event updated for resources: {'Port': ['ID=bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:41.735236 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] Set router 0c94e502-26a1-42dd-908b-51f6bf18739f gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:47:41.992519 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'name': 'router1', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:47:19Z', 'updated_at': '2021-11-12T14:47:37Z', 'revision_number': 4, 'project_id': 'a220f551522747ae924daef8ce89528e', 'gw_port': {'id': 'bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:a2:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:47:37Z', 'updated_at': '2021-11-12T14:47:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '24b69086-b243-4c33-8a12-0d3e5885aa53', 'name': '', 'network_id': 'faf50048-e9bd-4919-b550-5674938db925', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'mac_address': 'fa:16:3e:90:89:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ce270279-445b-4401-8389-acc15325891f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:47:29Z', 'updated_at': '2021-11-12T14:47:32Z', 'revision_number': 5, 'project_id': 'a220f551522747ae924daef8ce89528e', 'subnets': [{'id': 'ce270279-445b-4401-8389-acc15325891f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1921802a-2e8c-4e4c-9a16-2135a375251e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:47:42.039531 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb67462b-377a-4f1a-af96-ca43e24e9537 None None] The sync data for ids ['0c94e502-26a1-42dd-908b-51f6bf18739f'] in dv-cinder-776422-5-iscsi is: [{'id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'name': 'router1', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.209'}], 'enable_snat': True}, 'gw_port_id': 'bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:47:19Z', 'updated_at': '2021-11-12T14:47:37Z', 'revision_number': 4, 'project_id': 'a220f551522747ae924daef8ce89528e', 'gw_port': {'id': 'bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:a2:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:47:37Z', 'updated_at': '2021-11-12T14:47:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '24b69086-b243-4c33-8a12-0d3e5885aa53', 'name': '', 'network_id': 'faf50048-e9bd-4919-b550-5674938db925', 'tenant_id': 'a220f551522747ae924daef8ce89528e', 'mac_address': 'fa:16:3e:90:89:83', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0c94e502-26a1-42dd-908b-51f6bf18739f', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ce270279-445b-4401-8389-acc15325891f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:47:29Z', 'updated_at': '2021-11-12T14:47:32Z', 'revision_number': 5, 'project_id': 'a220f551522747ae924daef8ce89528e', 'subnets': [{'id': 'ce270279-445b-4401-8389-acc15325891f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1921802a-2e8c-4e4c-9a16-2135a375251e'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:47:43.752874 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:47:43.817686 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:43.818264 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:43.919382 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:43.949761 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:47:43.954445 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:44.021310 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:47:45.728061 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:47:45.823978 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port bd42fb2b-3ff1-4111-bc7d-e3b9fe87572d triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:47:45.824742 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:52.064821 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-cf6f5ae0-e11a-4df4-aa8c-703dd2c0b727 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:54.478466 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d86f8816-8d2a-4c3a-9b2e-f07f1f4463e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:55.452519 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:56.354107 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:47:56.850378 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:47:57.844369 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:22.072953 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3b57927c-0140-4e3f-b874-4f995e43f580 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:24.488773 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b87362fd-6288-420e-a8da-01319dfd9127 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:25.478295 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:26.872390 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:27.854981 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:33.353464 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:48:52.058520 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8a520bc8-97d2-4785-a31d-95e67840b03f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:54.482237 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-585102cd-4cf4-4546-8c1c-d44894296d8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:55.457117 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:56.855686 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:48:57.848874 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:10.352992 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:49:20.675343 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51484) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:20.751640 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.pecan_wsgi.hooks.translation [None req-53b885f8-4cb7-4161-a4de-613e25bfaa55 admin admin] GET failed (client error): The resource could not be found. Nov 12 14:49:20.753089 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-53b885f8-4cb7-4161-a4de-613e25bfaa55 admin admin] 10.222.0.61 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0766027 Nov 12 14:49:20.925672 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d108dea6-7c89-49bc-b378-405e924acb5c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:20.927174 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-d108dea6-7c89-49bc-b378-405e924acb5c admin admin] 10.222.0.61 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1684818 Nov 12 14:49:22.064273 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-58fe1f85-aaf0-4f0d-a95b-b0efc0650a11 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:23.298148 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51494) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:23.406249 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff6f6ed0-f16b-4578-858b-004f831234c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:23.407644 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-ff6f6ed0-f16b-4578-858b-004f831234c4 admin admin] 10.222.0.61 "GET /v2.0/subnets/ce270279-445b-4401-8389-acc15325891f HTTP/1.1" status: 200 len: 849 time: 0.1085413 Nov 12 14:49:23.423847 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:49:23.515195 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Publish callbacks [] for subnet, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:23.683512 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8744642596491'] for subnet, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:23.726335 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:23.727340 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:23.728902 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] 10.222.0.61 "PUT /v2.0/subnets/ce270279-445b-4401-8389-acc15325891f HTTP/1.1" status: 200 len: 868 time: 0.3092487 Nov 12 14:49:23.729675 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4aa1e2e-ce99-4103-afb0-90bc624256ca None None] Network faf50048-e9bd-4919-b550-5674938db925 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:49:23.753263 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Pushing event updated for resources: {'Subnet': ['ID=ce270279-445b-4401-8389-acc15325891f,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:49:23.762389 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.762920 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.763397 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.763859 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.764537 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.765070 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.765699 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.766161 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.766638 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.767107 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.767645 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:23.768160 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7dc7f9e6-aaef-4fe9-8e09-250ab6f5b14b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:49:24.239255 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-2d2b5e3b-fc99-44db-aff5-20e4f01f1cb6 None None] Provisioning complete for port 24b69086-b243-4c33-8a12-0d3e5885aa53 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:49:24.239985 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2d2b5e3b-fc99-44db-aff5-20e4f01f1cb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:24.370586 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-2d2b5e3b-fc99-44db-aff5-20e4f01f1cb6 None None] Provisioning complete for port f9d6e468-2dd4-4e21-8e05-d5fe046a03e7 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:49:24.371101 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2d2b5e3b-fc99-44db-aff5-20e4f01f1cb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:24.500684 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-41bd0f90-4ee9-4881-9372-77067440f414 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:25.468485 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:26.294923 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51502) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:26.529629 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70dfa0d0-9ef3-45f1-91e9-143919de49c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:26.530006 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70dfa0d0-9ef3-45f1-91e9-143919de49c4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:26.531616 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-70dfa0d0-9ef3-45f1-91e9-143919de49c4 admin admin] 10.222.0.61 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2357039 Nov 12 14:49:26.863320 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:27.858354 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:29.078393 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51510) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:29.262072 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c41b92cd-1539-4d14-ae5e-9c987d2006e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:29.262440 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c41b92cd-1539-4d14-ae5e-9c987d2006e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:29.264031 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-c41b92cd-1539-4d14-ae5e-9c987d2006e7 admin admin] 10.222.0.61 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1846724 Nov 12 14:49:31.674196 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51518) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:31.842198 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1010f5e8-1330-4198-a92e-3c0eeb19362b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:31.843779 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-1010f5e8-1330-4198-a92e-3c0eeb19362b admin admin] 10.222.0.61 "GET /v2.0/networks/bc8f81a5-42b5-4692-9e4b-bc049497e795 HTTP/1.1" status: 200 len: 886 time: 0.1686151 Nov 12 14:49:34.213536 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 51526) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:34.346330 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37559d8d-eff2-48ff-9794-607b1aff6122 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:34.347697 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-37559d8d-eff2-48ff-9794-607b1aff6122 admin admin] 10.222.0.61 "GET /v2.0/networks/faf50048-e9bd-4919-b550-5674938db925 HTTP/1.1" status: 200 len: 869 time: 0.1332076 Nov 12 14:49:36.701320 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 51536) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:36.840259 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45026de6-a680-481b-9157-0791f953b8de admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:36.840703 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45026de6-a680-481b-9157-0791f953b8de admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:36.842234 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-45026de6-a680-481b-9157-0791f953b8de admin admin] 10.222.0.61 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1399651 Nov 12 14:49:39.236909 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 51544) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:39.332710 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab93f6af-993c-4a2d-9279-20d8c7602ded admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:39.333151 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab93f6af-993c-4a2d-9279-20d8c7602ded admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:39.334686 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-ab93f6af-993c-4a2d-9279-20d8c7602ded admin admin] 10.222.0.61 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0968273 Nov 12 14:49:41.750106 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51552) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:41.849510 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4811c450-6378-4713-a340-f2ec6b392163 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:41.850883 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-4811c450-6378-4713-a340-f2ec6b392163 admin admin] 10.222.0.61 "GET /v2.0/subnets/ce270279-445b-4401-8389-acc15325891f HTTP/1.1" status: 200 len: 868 time: 0.0998216 Nov 12 14:49:44.234855 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51560) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:49:44.324691 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9dd3755f-d42f-4e2f-82d4-8183ce05d6da admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:49:44.326045 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-9dd3755f-d42f-4e2f-82d4-8183ce05d6da admin admin] 10.222.0.61 "GET /v2.0/subnets/f1d69314-a0d5-4375-876e-6ed7c4b8fa75 HTTP/1.1" status: 200 len: 816 time: 0.0902393 Nov 12 14:49:47.352079 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:49:52.055183 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-64521962-dda2-4101-a56e-fdf083c39c87 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:54.483045 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-133e15e2-0c99-467b-afed-d674de87b7da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:55.466758 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:56.860943 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:49:57.852801 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:08.982589 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51614) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:50:09.029597 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [None req-beab9981-f2a7-4e8e-9997-439684bd1d3e admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101617) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:50:09.030564 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-beab9981-f2a7-4e8e-9997-439684bd1d3e admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0470474 Nov 12 14:50:11.404232 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 51622) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:50:11.465687 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.pecan_wsgi.hooks.translation [None req-5654bc6b-7f1a-4d1e-8e70-c759a1bcc716 admin admin] GET failed (client error): The resource could not be found. Nov 12 14:50:11.467457 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-5654bc6b-7f1a-4d1e-8e70-c759a1bcc716 admin admin] 10.222.0.61 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0622909 Nov 12 14:50:11.614265 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6af48bae-fd0e-429d-94f6-0c64f9af79b6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:50:11.615676 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-6af48bae-fd0e-429d-94f6-0c64f9af79b6 admin admin] 10.222.0.61 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1434617 Nov 12 14:50:13.952986 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51630) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:50:14.001310 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:50:14.022798 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Made reservation on behalf of b105d23e427d4917aadff2e66652012b for: {'network': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:50:14.025705 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:14.059828 dv-cinder-776422-5-iscsi neutron-server[101617]: WARNING neutron.services.revisions.revision_plugin [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Could not find related network for resource to bump revision. Nov 12 14:50:14.073317 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 613} {{(pid=101617) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:50:14.083033 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:14.083399 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.segments_db [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Added segment abab7d4b-dd33-47ea-9ae7-a14276956d50 of type vlan for network eedb8d3b-4491-485a-baa5-f4a9a1678e79 Nov 12 14:50:14.123981 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:14.149641 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:14.150735 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:50:14.151329 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:14.209159 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2550573 Nov 12 14:50:14.217085 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-504116f0-0d1d-45ef-98e6-65d4a676b36e admin admin] Pushing event updated for resources: {'Network': ['ID=eedb8d3b-4491-485a-baa5-f4a9a1678e79,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:50:14.228615 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network eedb8d3b-4491-485a-baa5-f4a9a1678e79 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:50:16.525918 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51638) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:50:16.588095 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.pecan_wsgi.hooks.translation [None req-148b73ae-e8b9-4523-9df6-a337c9fd6fc9 admin admin] GET failed (client error): The resource could not be found. Nov 12 14:50:16.589483 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-148b73ae-e8b9-4523-9df6-a337c9fd6fc9 admin admin] 10.222.0.61 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0625405 Nov 12 14:50:16.663240 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f61d70b-a566-4f38-a415-aa7b2b12d50f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:50:16.665330 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-2f61d70b-a566-4f38-a415-aa7b2b12d50f admin admin] 10.222.0.61 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0704813 Nov 12 14:50:16.675717 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79', 'name': 'shared-subnet', 'ip_version': 4, 'description': 'shared-subnet'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:50:16.695094 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Made reservation on behalf of b105d23e427d4917aadff2e66652012b for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:50:16.697356 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:16.859912 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:16.956824 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=37bb356a-16a4-4d46-b3c4-c0e6bd1e7b39,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:50:16.965663 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Checking segment: {'id': 'abab7d4b-dd33-47ea-9ae7-a14276956d50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:50:16.966014 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Network hostable DHCP agents. Network: eedb8d3b-4491-485a-baa5-f4a9a1678e79, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:50:16.982984 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Network eedb8d3b-4491-485a-baa5-f4a9a1678e79 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:50:16.992298 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, eedb8d3b-4491-485a-baa5-f4a9a1678e79) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:50:16.996620 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:50:16.997192 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:17.001769 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3f84ea6-a2a2-4218-b674-2aecb16538dc None None] Network eedb8d3b-4491-485a-baa5-f4a9a1678e79 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:50:17.012739 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-3e4e7687-780b-47cc-a698-26d007dd0ad6 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3404212 Nov 12 14:50:17.243841 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-eedb8d3b-4491-485a-baa5-f4a9a1678e79', 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79', 'tenant_id': 'b105d23e427d4917aadff2e66652012b', 'fixed_ips': [{'subnet_id': '37bb356a-16a4-4d46-b3c4-c0e6bd1e7b39'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 14:50:17.244786 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:17.382530 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Allocated IP 192.168.233.2 (eedb8d3b-4491-485a-baa5-f4a9a1678e79/37bb356a-16a4-4d46-b3c4-c0e6bd1e7b39/60918364-2f8a-4ccd-b689-74b68ae6e1be) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:50:17.531296 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:17.538254 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:17.583149 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Network eedb8d3b-4491-485a-baa5-f4a9a1678e79 is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:50:17.586072 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:50:17.589133 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:50:17.594943 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Pushing event updated for resources: {'Port': ['ID=60918364-2f8a-4ccd-b689-74b68ae6e1be,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:50:17.605204 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.605567 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.606320 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.606320 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.606530 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.606833 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.607152 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.607464 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.607795 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.608181 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.608455 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.608769 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:50:17.659676 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Attempting to bind port 60918364-2f8a-4ccd-b689-74b68ae6e1be on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:50:17.660047 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Attempting to bind port 60918364-2f8a-4ccd-b689-74b68ae6e1be by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': 'abab7d4b-dd33-47ea-9ae7-a14276956d50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:50:17.660448 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Attempting to bind port 60918364-2f8a-4ccd-b689-74b68ae6e1be on network eedb8d3b-4491-485a-baa5-f4a9a1678e79 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:50:17.666192 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 49, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:50:17.666552 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Checking segment: {'id': 'abab7d4b-dd33-47ea-9ae7-a14276956d50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:50:17.666939 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:17.667320 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Bound using segment: {'id': 'abab7d4b-dd33-47ea-9ae7-a14276956d50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:50:17.667771 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Bound port: 60918364-2f8a-4ccd-b689-74b68ae6e1be, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'abab7d4b-dd33-47ea-9ae7-a14276956d50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:50:17.668177 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:17.729728 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] For port 60918364-2f8a-4ccd-b689-74b68ae6e1be, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:50:17.733087 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] For port 60918364-2f8a-4ccd-b689-74b68ae6e1be, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=60918364-2f8a-4ccd-b689-74b68ae6e1be,segment=NetworkSegment(abab7d4b-dd33-47ea-9ae7-a14276956d50),segment_id=abab7d4b-dd33-47ea-9ae7-a14276956d50)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:50:17.738134 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:17.794849 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270e4235-0d18-43f0-aded-a39acc52aa39 None None] Pushing event updated for resources: {'Port': ['ID=60918364-2f8a-4ccd-b689-74b68ae6e1be,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:50:18.638469 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b6d6369-259e-4f8d-a821-73df04149623 None None] Network eedb8d3b-4491-485a-baa5-f4a9a1678e79 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:50:18.702913 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-0210bbe8-7824-44a3-8534-ac5a97ad2662 None None] Provisioning complete for port 60918364-2f8a-4ccd-b689-74b68ae6e1be triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:50:18.703271 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0210bbe8-7824-44a3-8534-ac5a97ad2662 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:18.841990 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0210bbe8-7824-44a3-8534-ac5a97ad2662 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:18.881464 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-0210bbe8-7824-44a3-8534-ac5a97ad2662 None None] For port 60918364-2f8a-4ccd-b689-74b68ae6e1be, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=60918364-2f8a-4ccd-b689-74b68ae6e1be,segment=NetworkSegment(abab7d4b-dd33-47ea-9ae7-a14276956d50),segment_id=abab7d4b-dd33-47ea-9ae7-a14276956d50)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:50:18.885991 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0210bbe8-7824-44a3-8534-ac5a97ad2662 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:18.961140 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0210bbe8-7824-44a3-8534-ac5a97ad2662 None None] Pushing event updated for resources: {'Port': ['ID=60918364-2f8a-4ccd-b689-74b68ae6e1be,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:50:19.116414 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-ec92395f-e4c5-4d3d-8a82-16471abf4710 None None] Provisioning complete for port 60918364-2f8a-4ccd-b689-74b68ae6e1be triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:50:19.116776 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ec92395f-e4c5-4d3d-8a82-16471abf4710 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:19.817780 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 60918364-2f8a-4ccd-b689-74b68ae6e1be up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:50:19.873863 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 60918364-2f8a-4ccd-b689-74b68ae6e1be triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:50:19.874238 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:22.056629 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-60b8db79-3b84-4bbf-bea0-a7349d705a20 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:24.350991 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:50:24.486650 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4a8106a7-d555-4e28-82ce-dd45150dbe5c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:25.466632 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:26.866587 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:27.855167 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:52.058342 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-dbdee305-1a82-41e7-ab4e-03cabe03d844 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:54.491092 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6186a8f2-2dfc-41a6-87d7-a94cee507b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:55.469769 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:56.872823 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:50:57.856698 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:01.349157 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:51:22.066097 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8c665610-a9af-4b27-a01b-5e7da9d0ade7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:24.494604 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-430bbf2b-3697-4282-a794-5b5c8e842ef0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:25.474841 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:26.877498 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:27.861398 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:30.146100 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51682) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:51:30.152564 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [None req-17e546e7-1328-454e-ba30-c07cd51369c9 tempest-verify_tempest_config-1963477228 tempest-verify_tempest_config-1963477228-project] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101617) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:51:30.153561 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-17e546e7-1328-454e-ba30-c07cd51369c9 tempest-verify_tempest_config-1963477228 tempest-verify_tempest_config-1963477228-project] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0065038 Nov 12 14:51:30.471826 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 51700) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:51:30.583307 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:30.665483 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:30.670671 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:30.715967 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e06df8b8-366a-4d77-9e10-290f04759f32,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:51:30.719741 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=08f5c2d5ab284316a25f223fe78a30dc&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2468953 Nov 12 14:51:30.722799 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51706) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:51:30.725200 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.725559 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.725899 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.726223 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.726545 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.727421 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.727742 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.728077 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.728446 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.728770 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.729079 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.729392 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f38b19e1-4952-456b-a26b-8979ca288079 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.783260 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:30.806439 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:30.901958 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:30.904894 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:30.906079 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/e06df8b8-366a-4d77-9e10-290f04759f32 HTTP/1.1" status: 204 len: 168 time: 0.1822340 Nov 12 14:51:30.913989 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e06df8b8-366a-4d77-9e10-290f04759f32,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:51:30.921596 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.921972 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.922323 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.922750 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.923077 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.923426 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.923764 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.924260 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.924493 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.924795 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.925444 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:30.925444 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7fe23830-656d-46d6-b464-ccaaceb4d139 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:51:38.347248 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:51:52.060027 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6c9f91a9-eaf5-469e-af98-9d9408edecd4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:54.497690 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3eb24d54-2c37-4d5e-af9c-f708e663eeec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:55.474205 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:56.877074 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:51:57.863699 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:15.346035 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:52:22.062492 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-da5b43c7-1851-48fb-bf5b-5c0679c70c20 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:24.500255 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-84eaeedf-9e0b-4984-ab4f-fa9a4085c2f8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:25.476279 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:26.875984 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:27.864516 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:52.066076 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-34e303e1-5993-4287-bdf4-ffe2b6330875 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:52.344290 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 5 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:52:54.503442 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0cb25a3f-5503-42c7-a4c9-548c0203c5bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:55.481689 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:56.880769 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:52:57.867322 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:04.938581 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1753272'] for agent, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:20.663620 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51780) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:53:20.766300 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f99ad3e3-13b0-4e5f-84aa-0188e29e160b admin admin] 10.222.0.61 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1010468 Nov 12 14:53:22.068417 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b79484c8-38b2-4e50-87a1-a76dd3d8343e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:23.089022 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 51790) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:53:23.143311 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6571c0a5-9c52-4c1e-858d-03e9e7012800 admin admin] 10.222.0.61 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0531421 Nov 12 14:53:24.505190 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8d7df354-0fac-4bfb-b931-fd940ddd2e9d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:25.482686 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:26.883516 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:27.870077 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:29.343199 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:53:34.890913 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:52.073112 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-9d00d7a2-6f0a-44f2-9b3a-672445d8c669 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:54.506762 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-15dba3d3-1237-4ec6-bbb8-beaab736aaf2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:55.484766 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:56.885744 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:53:57.871546 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:04.906319 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:06.342923 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:54:22.076059 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-afe26f0a-2180-4812-ba5f-ed5107d9a282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:24.508966 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-32b7617d-3d17-4370-af1f-b5d030e81b99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:25.487832 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:26.890663 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:27.874469 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:34.903030 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:43.341525 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:54:52.083211 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-201fad41-c984-46ec-9b27-0005dce70390 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:52.999996 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 51988) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:53.025958 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 51994) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:53.056125 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52000) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:53.210357 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52010) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:53.339093 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1416349936-network', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:53.350161 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-521639591-network', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:53.372080 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.db.api [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 12 14:54:53.372080 dv-cinder-776422-5-iscsi neutron-server[101618]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Nov 12 14:54:53.372080 dv-cinder-776422-5-iscsi neutron-server[101618]: [parameters: {'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'id': '4e4ebb72-d559-4ed3-8644-079a92485fd5', 'expiration': datetime.datetime(2021, 11, 12, 14, 56, 53, 365155)}] Nov 12 14:54:53.372080 dv-cinder-776422-5-iscsi neutron-server[101618]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=101618) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 12 14:54:53.372496 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG oslo_db.api [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 12 14:54:53.379477 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Made reservation on behalf of 2040ee65b5fa46299ec3a2b82d7464ff for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:53.382264 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.388332 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1507282434-network', 'tenant_id': 'c5cd628706954cf7a4c6ff4180751364'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:53.406709 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.424804 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Made reservation on behalf of c5cd628706954cf7a4c6ff4180751364 for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:53.427899 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.438096 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.538357 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.543684 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.568488 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 636} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:54:53.581365 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.581714 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Added segment 596317c1-3ea0-41df-b1b0-0fd9146ab825 of type vlan for network c99d116e-3040-4028-8675-ad12dd87958d Nov 12 14:54:53.675187 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.707677 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.710550 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1d806b9c-55a2-4517-9ffc-a15fbecdc272,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:53.714857 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.716149 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:53.716722 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.725258 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.798563 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1104326232-network', 'tenant_id': '7f28b8acd9314945ab72867be957f076'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:53.804484 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.805068 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.805571 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.806059 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.806726 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.807233 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.807731 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.808070 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.808422 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.808742 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.809057 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.809373 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Tracked resource versions report: Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: pushed versions: Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: { 'AddressGroup': {'1.2'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'ConntrackHelper': {'1.0'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Log': {'1.0'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Network': {'1.1'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Port': {'1.7'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'PortForwarding': {'1.2'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'QosPolicy': {'1.10'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SecurityGroup': {'1.5'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SecurityGroupRule': {'1.2'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SubPort': {'1.0'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Subnet': {'1.1'}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Trunk': {'1.1'}} Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: consumer versions: Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: { DHCP agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: HyperV agent@hv-cinder-77642: {}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: L3 agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: Metadata agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: Metering agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: Open vSwitch agent@dv-cinder-776422-5-iscsi: { 'AddressGroup': '1.2', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'ConntrackHelper': '1.0', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Log': '1.0', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Network': '1.1', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Port': '1.7', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'PortForwarding': '1.2', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'QosPolicy': '1.10', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SecurityGroup': '1.5', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SecurityGroupRule': '1.2', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'SubPort': '1.0', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Subnet': '1.1', Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: 'Trunk': '1.1'}} Nov 12 14:54:53.810452 dv-cinder-776422-5-iscsi neutron-server[101618]: {{(pid=101618) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 12 14:54:53.819626 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7584851 Nov 12 14:54:53.822074 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52034) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:53.827242 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-562ec7cc-956c-4ebe-8975-00f1d708ab0c admin admin] Pushing event updated for resources: {'Network': ['ID=c99d116e-3040-4028-8675-ad12dd87958d,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:53.835495 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Request body: {'subnet': {'network_id': 'c99d116e-3040-4028-8675-ad12dd87958d', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1507282434-subnet', 'tenant_id': 'c5cd628706954cf7a4c6ff4180751364', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:53.843808 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 619} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:54:53.862167 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network c99d116e-3040-4028-8675-ad12dd87958d details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:54:53.873161 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.db.api [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 12 14:54:53.873161 dv-cinder-776422-5-iscsi neutron-server[101617]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Nov 12 14:54:53.873161 dv-cinder-776422-5-iscsi neutron-server[101617]: [parameters: {'project_id_1': 'c5cd628706954cf7a4c6ff4180751364', 'expiration_1': datetime.datetime(2021, 11, 12, 14, 54, 33, 849560)}] Nov 12 14:54:53.873161 dv-cinder-776422-5-iscsi neutron-server[101617]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=101617) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 12 14:54:53.873985 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG oslo_db.api [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 12 14:54:53.884739 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9774d03-ce85-458c-9d68-d51cdef58799,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:53.889744 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.890304 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Added segment 38b1dcbf-888a-4fe0-aecf-902b01be2bc6 of type vlan for network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce Nov 12 14:54:53.916266 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Made reservation on behalf of 7f28b8acd9314945ab72867be957f076 for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:53.919403 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.930818 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.934490 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Made reservation on behalf of e9ecca05e4af49c9b46cc186e0517c9c for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:53.936877 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:53.985700 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.008965 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.041328 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.042389 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:54.042973 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.121254 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] Pushing event updated for resources: {'Network': ['ID=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:54.135073 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52056) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:54.135714 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:54:54.140199 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Request body: {'subnet': {'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-subnet', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:54.144146 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-2708ff22-d081-4e98-b1e3-2b6db9552d4a admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.1169045 Nov 12 14:54:54.180842 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Made reservation on behalf of 2040ee65b5fa46299ec3a2b82d7464ff for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:54.183311 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.349030 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.369075 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.391293 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.402249 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.408971 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Made reservation on behalf of c5cd628706954cf7a4c6ff4180751364 for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:54.412733 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.438586 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 640} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:54:54.464700 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 642} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:54:54.470444 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=433970e3-9639-4c7f-a918-ba91e4121bf0,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:54.512239 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.512239 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Added segment bbbc80db-5f6d-48fe-8dfa-3286a8c2bcce of type vlan for network 3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81 Nov 12 14:54:54.515766 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.516168 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Added segment 5f55f816-14d6-46e6-8ced-6c264b88865e of type vlan for network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 Nov 12 14:54:54.518881 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-668b0467-4680-4c8f-8585-9dcb1786c8ef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.565929 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.633941 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.662404 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c43c8cee-a574-46dd-a048-f6b09bf7f409,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:54.667590 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.669070 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:54.669904 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.861607 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.870149 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Pushing event updated for resources: {'Subnet': ['ID=03d9b81e-6504-49f1-9d77-32a1bea3505d,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:54.874393 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.881145 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.6699362 Nov 12 14:54:54.892219 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52098) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:54.893193 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9e281d7-b73e-4dfe-aba1-bfc1dc8ebd49 admin admin] Pushing event updated for resources: {'Network': ['ID=3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:54.905607 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:54:54.909524 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Request body: {'subnet': {'network_id': '3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1104326232-subnet', 'tenant_id': '7f28b8acd9314945ab72867be957f076', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:54.937848 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.939722 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:54.940485 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.988362 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:54.990577 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:54.990997 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Made reservation on behalf of 7f28b8acd9314945ab72867be957f076 for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:54.992233 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:54.992663 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:54.994020 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:54.994471 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:54.994912 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:54.995330 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:54.996077 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:54.996310 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:55.002900 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:55.003517 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:55.004533 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Tracked resource versions report: Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: pushed versions: Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: { 'AddressGroup': {'1.2'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'ConntrackHelper': {'1.0'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Log': {'1.0'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Network': {'1.1'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Port': {'1.7'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'PortForwarding': {'1.2'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'QosPolicy': {'1.10'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SecurityGroup': {'1.5'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SecurityGroupRule': {'1.2'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SubPort': {'1.0'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Subnet': {'1.1'}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Trunk': {'1.1'}} Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: consumer versions: Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: { DHCP agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: HyperV agent@hv-cinder-77642: {}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: L3 agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: Metadata agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: Metering agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: Open vSwitch agent@dv-cinder-776422-5-iscsi: { 'AddressGroup': '1.2', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'ConntrackHelper': '1.0', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Log': '1.0', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Network': '1.1', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Port': '1.7', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'PortForwarding': '1.2', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'QosPolicy': '1.10', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SecurityGroup': '1.5', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SecurityGroupRule': '1.2', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'SubPort': '1.0', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Subnet': '1.1', Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: 'Trunk': '1.1'}} Nov 12 14:54:55.005741 dv-cinder-776422-5-iscsi neutron-server[101617]: {{(pid=101617) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 12 14:54:55.028866 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 2.0269232 Nov 12 14:54:55.029525 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52114) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:55.054208 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Checking segment: {'id': '596317c1-3ea0-41df-b1b0-0fd9146ab825', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'c99d116e-3040-4028-8675-ad12dd87958d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:54:55.054562 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Network hostable DHCP agents. Network: c99d116e-3040-4028-8675-ad12dd87958d, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:54:55.062430 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Request body: {'subnet': {'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1416349936-subnet', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:55.070466 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Checking segment: {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:54:55.070827 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Network hostable DHCP agents. Network: 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:54:55.103438 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Network c99d116e-3040-4028-8675-ad12dd87958d is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:54:55.116431 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7109c5e5-0eea-4623-84c8-829f99f13830 admin admin] Pushing event updated for resources: {'Network': ['ID=cf063ae4-6fb7-44b8-9c9f-984a39a87f66,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:55.119714 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, c99d116e-3040-4028-8675-ad12dd87958d) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:54:55.125147 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:55.128660 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:54:55.138437 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.141677 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Made reservation on behalf of e9ecca05e4af49c9b46cc186e0517c9c for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:55.144337 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Publish callbacks [] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.163389 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f643faa6-8d52-4828-81ca-d93e7a302913 None None] Network c99d116e-3040-4028-8675-ad12dd87958d requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:55.168829 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.3442531 Nov 12 14:54:55.180685 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbbf7aa5-b9ea-4fed-a0d0-6b3080ea93e3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=dd2d4dae-b732-4123-90af-8645300420da,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:55.190036 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:54:55.199110 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:54:55.203257 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:55.203900 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.230402 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-25591a71-df9d-465b-851e-cdfbb9996e75 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.0909045 Nov 12 14:54:55.230761 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52120) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:55.237729 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:55.292500 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.303097 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.321647 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5620ebdd-e6af-4bbd-b708-6061d1956f82 None None] Network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:55.444582 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-647844d9-5cc2-44cf-aa6c-c484c3cd33fd None None] Network c99d116e-3040-4028-8675-ad12dd87958d requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:55.569121 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.646635 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.653039 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.796866 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6be99b0-dba3-4c1c-ae45-c79d60be24bc None None] Network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:55.854175 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9cdd000d-f6c0-4b02-a2c5-aeeb26b4e9a4,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:55.876269 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.893587 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:55.942751 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Checking segment: {'id': 'bbbc80db-5f6d-48fe-8dfa-3286a8c2bcce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:54:55.943058 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Network hostable DHCP agents. Network: 3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:54:55.987376 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Pushing event updated for resources: {'Subnet': ['ID=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:55.998277 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Network 3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:54:56.003508 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Checking segment: {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:54:56.003859 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Network hostable DHCP agents. Network: cf063ae4-6fb7-44b8-9c9f-984a39a87f66, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:54:56.016278 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:54:56.024554 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:56.025620 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.033902 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb94ecb9-a2a8-46fd-8025-b520cea77698 None None] Network 3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:56.038589 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:54:56.047024 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, cf063ae4-6fb7-44b8-9c9f-984a39a87f66) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:54:56.055241 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-7bda891e-8e11-46b3-bb0e-e0c0d63f2503 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.1591811 Nov 12 14:54:56.056946 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:56.057767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.086561 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-5d5ab1ca-1d5b-4656-9f2f-f79095c58b2b admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.0294499 Nov 12 14:54:56.087648 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52154) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:56.088314 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52156) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:56.110182 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:56.115361 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2630a287-9b67-4ccf-8070-f60cd8af1e54 None None] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:56.161194 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.162526 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.273615 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.530173 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.585884 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52188) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:56.587493 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.596631 dv-cinder-776422-5-iscsi neutron-server[101618]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 12 14:54:56.644279 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-058abe5c-69c2-424f-a6cf-4f3de54f473b None None] Network 3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:56.653486 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.876786 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 14:54:56.877835 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.914600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-dbbefff4-cc73-466d-a895-f1aa337751f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:56.922298 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Allocated IP 172.27.3.138 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:54:57.116556 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.139646 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52208) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:57.146219 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Allocated IP 172.20.0.2 (cf063ae4-6fb7-44b8-9c9f-984a39a87f66/f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2/6ee7533c-cce1-4c6b-a77b-020ee68933f1) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:54:57.183303 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52214) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:57.193173 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1782703829-network', 'tenant_id': 'f3baad2f70454e6ead6ef2f2c94ab874'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:57.213238 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21255210-6730-4071-96d9-4096a52abbeb req-68819aac-a0c7-4cc9-adb7-26b79200188a tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:57.215690 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-68819aac-a0c7-4cc9-adb7-26b79200188a tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/networks?id=c99d116e-3040-4028-8675-ad12dd87958d HTTP/1.1" status: 200 len: 812 time: 0.6267002 Nov 12 14:54:57.225669 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.248156 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-2d0e8c6f-4982-460f-8895-57051d5f58ff tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/quotas/c5cd628706954cf7a4c6ff4180751364 HTTP/1.1" status: 200 len: 375 time: 0.0236781 Nov 12 14:54:57.311971 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.343999 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.348654 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-8bcd7146-4ba2-48da-a327-0506da4685c6 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=c5cd628706954cf7a4c6ff4180751364&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0855234 Nov 12 14:54:57.356774 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Made reservation on behalf of f3baad2f70454e6ead6ef2f2c94ab874 for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:57.359442 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.361208 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.396076 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:54:57.402799 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:54:57.406294 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.410537 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:54:57.437407 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:54:57.440931 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:54:57.445038 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:54:57.471050 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Pushing event updated for resources: {'Port': ['ID=6ee7533c-cce1-4c6b-a77b-020ee68933f1,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:57.477226 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-dbbefff4-cc73-466d-a895-f1aa337751f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.501021 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.501402 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.501751 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.502226 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.503181 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.503536 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.503868 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.504218 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.505148 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-dbbefff4-cc73-466d-a895-f1aa337751f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.505588 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.505710 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Pushing event updated for resources: {'Port': ['ID=318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:57.505924 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.506296 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.506610 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Tracked resource versions report: Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: pushed versions: Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: { 'AddressGroup': {'1.2'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'ConntrackHelper': {'1.0'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Log': {'1.0'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Network': {'1.1'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Port': {'1.7'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'PortForwarding': {'1.2'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'QosPolicy': {'1.10'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SecurityGroup': {'1.5'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SecurityGroupRule': {'1.2'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SubPort': {'1.0'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Subnet': {'1.1'}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Trunk': {'1.1'}} Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: consumer versions: Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: { DHCP agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: HyperV agent@hv-cinder-77642: {}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: L3 agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: Metadata agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: Metering agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: Open vSwitch agent@dv-cinder-776422-5-iscsi: { 'AddressGroup': '1.2', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'ConntrackHelper': '1.0', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Log': '1.0', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Network': '1.1', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Port': '1.7', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'PortForwarding': '1.2', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'QosPolicy': '1.10', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SecurityGroup': '1.5', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SecurityGroupRule': '1.2', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'SubPort': '1.0', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Subnet': '1.1', Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: 'Trunk': '1.1'}} Nov 12 14:54:57.507814 dv-cinder-776422-5-iscsi neutron-server[101619]: {{(pid=101619) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 12 14:54:57.558211 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Attempting to bind port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:54:57.558785 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Attempting to bind port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:54:57.559480 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Attempting to bind port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 on network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:54:57.567098 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 54, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:54:57.567991 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Checking segment: {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:54:57.568633 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.569189 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Bound using segment: {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:54:57.570460 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Bound port: 6ee7533c-cce1-4c6b-a77b-020ee68933f1, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:54:57.571041 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.626483 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c2e64cd-fdcf-40b1-9e0d-cb004f2acbaf admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.633341 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.639136 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbbefff4-cc73-466d-a895-f1aa337751f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b43d1ccb-0d9f-4093-bf9f-ec3fc3db589d,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:57.673148 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] For port 6ee7533c-cce1-4c6b-a77b-020ee68933f1, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:54:57.678900 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] For port 6ee7533c-cce1-4c6b-a77b-020ee68933f1, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=6ee7533c-cce1-4c6b-a77b-020ee68933f1,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:54:57.684271 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.708237 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.741160 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 641} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:54:57.756204 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c60b0cf9-780c-469d-b4c5-102be9ac9dcb None None] Pushing event updated for resources: {'Port': ['ID=6ee7533c-cce1-4c6b-a77b-020ee68933f1,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:57.793291 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.793291 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Added segment 76703328-5110-41f6-99fd-a8b8776599f5 of type vlan for network 6208c67b-11d2-4ac7-aa7a-6de805656c74 Nov 12 14:54:57.821668 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.849679 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-ceb6cde8-cdad-4b47-9723-e2e2339fbb39 service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101618) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:54:57.863246 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-ceb6cde8-cdad-4b47-9723-e2e2339fbb39 service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2650774 Nov 12 14:54:57.894472 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.929550 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.978371 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:57.979352 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:57.979868 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.000645 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-dbbefff4-cc73-466d-a895-f1aa337751f6 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=bcf7197d16f945ea8605637c679877e4&name=default HTTP/1.1" status: 200 len: 2992 time: 1.9085383 Nov 12 14:54:58.011405 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52236) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:58.033925 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.8473222 Nov 12 14:54:58.068785 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52240) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:58.074063 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Request body: {'subnet': {'network_id': '6208c67b-11d2-4ac7-aa7a-6de805656c74', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1782703829-subnet', 'tenant_id': 'f3baad2f70454e6ead6ef2f2c94ab874', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:54:58.154581 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a98d5ef7-a9a9-4a51-b20b-dd1d76e28c86,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:58.275987 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Made reservation on behalf of f3baad2f70454e6ead6ef2f2c94ab874 for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:54:58.275987 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.275987 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.437517 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.470149 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1cc10d7-c351-4a25-9722-5577fa1d4c6d admin admin] Pushing event updated for resources: {'Network': ['ID=6208c67b-11d2-4ac7-aa7a-6de805656c74,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:58.485307 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 6208c67b-11d2-4ac7-aa7a-6de805656c74 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:54:58.508847 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.545442 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c2e64cd-fdcf-40b1-9e0d-cb004f2acbaf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.584087 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Router 987f2aa3-654a-4bf7-92e0-07095fb78d18 is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101617) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 14:54:58.590135 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.590377 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c2e64cd-fdcf-40b1-9e0d-cb004f2acbaf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.634253 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-be503034-e7ef-4a36-9851-b5fbd112eda6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.641838 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c2e64cd-fdcf-40b1-9e0d-cb004f2acbaf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f5a4167-5470-4ad8-ba7f-827647d141e9,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:58.652066 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6d0b1696-db48-4041-8a08-7e1798c0d059,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:58.655443 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-1902b603-016b-48ed-840f-3f880ba94460 service neutron] 10.222.0.61 "GET /v2.0/networks/c99d116e-3040-4028-8675-ad12dd87958d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7907162 Nov 12 14:54:58.669250 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-3c2e64cd-fdcf-40b1-9e0d-cb004f2acbaf admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=61f31bc144c54b78994a966ba84ed7f8&name=default HTTP/1.1" status: 200 len: 2992 time: 1.4950271 Nov 12 14:54:58.681477 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52256) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:58.729245 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-be503034-e7ef-4a36-9851-b5fbd112eda6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.770985 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Checking segment: {'id': '76703328-5110-41f6-99fd-a8b8776599f5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '6208c67b-11d2-4ac7-aa7a-6de805656c74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:54:58.771337 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Network hostable DHCP agents. Network: 6208c67b-11d2-4ac7-aa7a-6de805656c74, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:54:58.805568 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:54:58.807758 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Network 6208c67b-11d2-4ac7-aa7a-6de805656c74 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:54:58.819700 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Sync routers for ids ['987f2aa3-654a-4bf7-92e0-07095fb78d18'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:54:58.821891 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 6208c67b-11d2-4ac7-aa7a-6de805656c74) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:54:58.826967 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:54:58.827592 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.835829 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aceb035d-6169-4f96-851e-b925d5e8981e None None] Network 6208c67b-11d2-4ac7-aa7a-6de805656c74 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:58.841561 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Routers {'987f2aa3-654a-4bf7-92e0-07095fb78d18'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:54:58.842440 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:54:54Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['987f2aa3-654a-4bf7-92e0-07095fb78d18'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:54:58.857368 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] Publish callbacks [] for router, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:58.861428 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6174420a-a101-4a65-a76a-a297a6033369 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 3.6268244 Nov 12 14:54:58.869565 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52262) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:58.882005 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-a45130e9-4430-46bd-8a3c-14f515946077 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.8120875 Nov 12 14:54:59.041646 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52266) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:59.062317 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Allocated IP 172.27.3.50 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/28e0c573-48d9-421d-be0b-6000eb77163c) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:54:59.084937 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a667a653-2b0f-48b7-a1e7-ae59f3ea1d7f None None] Network 6208c67b-11d2-4ac7-aa7a-6de805656c74 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:59.157031 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3a43188f-1cd1-47e7-bf25-8d1469919d5e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.199243 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-c72bf496-5995-47f1-83f2-b817104174e2 service neutron] 10.222.0.61 "GET /v2.0/networks/c99d116e-3040-4028-8675-ad12dd87958d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5285697 Nov 12 14:54:59.227315 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_v2 [None req-64163798-6632-4856-8ff9-0ceeecb5024b admin admin] Deleting subnet 9cdd000d-f6c0-4b02-a2c5-aeeb26b4e9a4 {{(pid=101618) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 14:54:59.236846 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3a43188f-1cd1-47e7-bf25-8d1469919d5e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.238842 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-64163798-6632-4856-8ff9-0ceeecb5024b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.240863 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-be503034-e7ef-4a36-9851-b5fbd112eda6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.244097 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-be503034-e7ef-4a36-9851-b5fbd112eda6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.253312 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-be503034-e7ef-4a36-9851-b5fbd112eda6 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/b43d1ccb-0d9f-4093-bf9f-ec3fc3db589d HTTP/1.1" status: 204 len: 168 time: 1.2316933 Nov 12 14:54:59.296162 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Set router 987f2aa3-654a-4bf7-92e0-07095fb78d18 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:54:59.346663 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be503034-e7ef-4a36-9851-b5fbd112eda6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b43d1ccb-0d9f-4093-bf9f-ec3fc3db589d,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:59.388413 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-64163798-6632-4856-8ff9-0ceeecb5024b admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.413199 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-64163798-6632-4856-8ff9-0ceeecb5024b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.483082 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8752fc3-05f9-4e1f-89ff-23a2e7410e60 None None] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:54:59.545775 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3a43188f-1cd1-47e7-bf25-8d1469919d5e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.560739 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3a43188f-1cd1-47e7-bf25-8d1469919d5e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.561728 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-3a43188f-1cd1-47e7-bf25-8d1469919d5e admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/6f5a4167-5470-4ad8-ba7f-827647d141e9 HTTP/1.1" status: 204 len: 168 time: 0.8767247 Nov 12 14:54:59.615763 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.622139 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a43188f-1cd1-47e7-bf25-8d1469919d5e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f5a4167-5470-4ad8-ba7f-827647d141e9,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:59.696748 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138'}], 'enable_snat': True}, 'gw_port_id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:55Z', 'updated_at': '2021-11-12T14:54:57Z', 'revision_number': 3, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'gw_port': {'id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:31:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:54:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:54:59.724612 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-64163798-6632-4856-8ff9-0ceeecb5024b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.796213 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Checking router: 987f2aa3-654a-4bf7-92e0-07095fb78d18 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:54:59.799606 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-64163798-6632-4856-8ff9-0ceeecb5024b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.803481 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-64163798-6632-4856-8ff9-0ceeecb5024b admin admin] 10.222.0.61 "DELETE /v2.0/subnets/9cdd000d-f6c0-4b02-a2c5-aeeb26b4e9a4 HTTP/1.1" status: 204 len: 168 time: 0.7557178 Nov 12 14:54:59.804321 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Updating router 987f2aa3-654a-4bf7-92e0-07095fb78d18 port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:54:59.808548 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52294) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:59.831808 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52298) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:54:59.842236 dv-cinder-776422-5-iscsi neutron-server[101617]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 12 14:54:59.858920 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64163798-6632-4856-8ff9-0ceeecb5024b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9cdd000d-f6c0-4b02-a2c5-aeeb26b4e9a4,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:59.877537 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.890160 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-5b97d5f3-8be5-4acd-bddf-3b2e29e393a1 None None] Provisioning complete for port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:54:59.890658 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5b97d5f3-8be5-4acd-bddf-3b2e29e393a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.901311 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:54:59.966315 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Pushing event updated for resources: {'Port': ['ID=28e0c573-48d9-421d-be0b-6000eb77163c,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:54:59.992228 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:54:59.994630 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:00.000718 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:55:00.111104 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.126925 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 6ee7533c-cce1-4c6b-a77b-020ee68933f1 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:00.157493 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1995aa15-62f2-4a8f-a800-b9d3ab66dcc1 req-7d6689fc-2f66-41a5-9b64-c5311fafef10 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.3163800 Nov 12 14:55:00.278330 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5b97d5f3-8be5-4acd-bddf-3b2e29e393a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.326817 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-5b97d5f3-8be5-4acd-bddf-3b2e29e393a1 None None] For port 6ee7533c-cce1-4c6b-a77b-020ee68933f1, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=6ee7533c-cce1-4c6b-a77b-020ee68933f1,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:00.333413 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5b97d5f3-8be5-4acd-bddf-3b2e29e393a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.413132 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b97d5f3-8be5-4acd-bddf-3b2e29e393a1 None None] Pushing event updated for resources: {'Port': ['ID=6ee7533c-cce1-4c6b-a77b-020ee68933f1,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:00.414436 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.421467 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:00.421686 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.458239 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.458625 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.459377 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.464041 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > port after_create 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.468956 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > port after_delete 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.469305 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > port after_update 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.469652 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.470142 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.470462 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.470876 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.480843 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.491716 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.497435 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.504486 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52314) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:00.541676 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-5c04d3d0-6266-4517-a8f6-960a73da70c9 None None] Provisioning complete for port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:00.542059 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5c04d3d0-6266-4517-a8f6-960a73da70c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.566488 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Pushing event updated for resources: {'Port': ['ID=318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1,revision_number=2']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:00.570271 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Attempting to bind port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:55:00.570812 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Attempting to bind port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:55:00.571394 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Attempting to bind port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:00.582133 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 54, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:55:00.583357 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:55:00.583932 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.584507 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:55:00.585142 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Bound port: 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:55:00.585809 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.594325 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b63d6c5c-282a-4ee1-9f6b-69cb293d13b8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.624340 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.624886 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.625366 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.625867 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.626615 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.627099 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.627626 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.628169 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.628677 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.629207 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.629689 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.630301 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Tracked resource versions report: Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: pushed versions: Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: { 'AddressGroup': {'1.2'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'ConntrackHelper': {'1.0'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Log': {'1.0'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Network': {'1.1'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Port': {'1.7'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'PortForwarding': {'1.2'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'QosPolicy': {'1.10'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SecurityGroup': {'1.5'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SecurityGroupRule': {'1.2'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SubPort': {'1.0'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Subnet': {'1.1'}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Trunk': {'1.1'}} Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: consumer versions: Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: { DHCP agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: HyperV agent@hv-cinder-77642: {}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: L3 agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: Metadata agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: Metering agent@dv-cinder-776422-5-iscsi: {}, Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: Open vSwitch agent@dv-cinder-776422-5-iscsi: { 'AddressGroup': '1.2', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'ConntrackHelper': '1.0', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Log': '1.0', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Network': '1.1', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Port': '1.7', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'PortForwarding': '1.2', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'QosPolicy': '1.10', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SecurityGroup': '1.5', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SecurityGroupRule': '1.2', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'SubPort': '1.0', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Subnet': '1.1', Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: 'Trunk': '1.1'}} Nov 12 14:55:00.631724 dv-cinder-776422-5-iscsi neutron-server[101620]: {{(pid=101620) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 12 14:55:00.730146 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] For port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:55:00.746138 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] For port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:55:00.751947 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.836497 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Routers {'987f2aa3-654a-4bf7-92e0-07095fb78d18'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:55:00.837046 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:54:54Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['987f2aa3-654a-4bf7-92e0-07095fb78d18'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:00.842365 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72360c3c-5566-46ff-803b-49acf0909a9f None None] Pushing event updated for resources: {'Port': ['ID=318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:00.881679 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b63d6c5c-282a-4ee1-9f6b-69cb293d13b8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.891079 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b63d6c5c-282a-4ee1-9f6b-69cb293d13b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.923584 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.924093 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.924363 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.924774 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=101617) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:55:00.925167 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:00.971932 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b63d6c5c-282a-4ee1-9f6b-69cb293d13b8 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=55c6abd2559c4a20b1c38df5c2fdbc0e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.4661188 Nov 12 14:55:00.974407 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52340) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:00.984041 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:00.987494 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b63d6c5c-282a-4ee1-9f6b-69cb293d13b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e313da6-5aa9-4c5f-9756-cd5ce74ec48a,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:00.992194 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.007904 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bbbc80db-5f6d-48fe-8dfa-3286a8c2bcce') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:01.008301 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bbbc80db-5f6d-48fe-8dfa-3286a8c2bcce') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:01.032094 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] Set router 987f2aa3-654a-4bf7-92e0-07095fb78d18 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:55:01.063683 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.114484 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.131515 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-27cc24d5-e171-41df-ab98-bb22e017f69b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.137907 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Releasing vlan 640 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 14:55:01.138321 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: from cryptography.utils import int_from_bytes Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: from cryptography.utils import int_from_bytes Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 14:55:01.145594 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 14:55:01.185542 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-27cc24d5-e171-41df-ab98-bb22e017f69b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.237629 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Router a08d9f45-c652-4276-867c-ab77c8f81aef is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101618) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 14:55:01.296853 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-27cc24d5-e171-41df-ab98-bb22e017f69b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.299933 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-27cc24d5-e171-41df-ab98-bb22e017f69b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.304094 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-27cc24d5-e171-41df-ab98-bb22e017f69b admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/2e313da6-5aa9-4c5f-9756-cd5ce74ec48a HTTP/1.1" status: 204 len: 168 time: 0.3230979 Nov 12 14:55:01.326975 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27cc24d5-e171-41df-ab98-bb22e017f69b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e313da6-5aa9-4c5f-9756-cd5ce74ec48a,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:01.345681 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138'}], 'enable_snat': True}, 'gw_port_id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:55Z', 'updated_at': '2021-11-12T14:54:57Z', 'revision_number': 3, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'gw_port': {'id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:31:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:01.384052 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3eaf1c02-c12f-452f-8bea-4648a7e3109f None None] The sync data for ids ['987f2aa3-654a-4bf7-92e0-07095fb78d18'] in dv-cinder-776422-5-iscsi is: [{'id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138'}], 'enable_snat': True}, 'gw_port_id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:55Z', 'updated_at': '2021-11-12T14:54:57Z', 'revision_number': 3, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'gw_port': {'id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:31:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:55:01.468413 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8115eb08-5eb3-411c-955a-765b42416226 req-18d4cc1b-23cf-471a-b32d-0495e45bbf9c tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.1570184 Nov 12 14:55:01.468413 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.468413 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.468413 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] 10.222.0.61 "DELETE /v2.0/networks/3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81 HTTP/1.1" status: 204 len: 168 time: 1.6539910 Nov 12 14:55:01.492625 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52362) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:01.493435 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f622056-a1df-4c5a-8b61-e8debb23bdb6 admin admin] Pushing event deleted for resources: {'Network': ['ID=3edfd3b8-9ca4-45e0-a2fa-9633e38e8e81,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:01.530164 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:55:01.546632 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Sync routers for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:55:01.586398 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:55:01.586937 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:54:54Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:01.597973 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.602609 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-06b7ec5f-76dd-47f1-be08-1e18896075c4 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 5.5117245 Nov 12 14:55:01.605601 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52366) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:01.765644 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-2ea25526-8aa5-4bcc-acd9-79f213c7da55 admin admin] Deleting subnet 6d0b1696-db48-4041-8a08-7e1798c0d059 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 14:55:01.779372 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2ea25526-8aa5-4bcc-acd9-79f213c7da55 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:01.994309 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2ea25526-8aa5-4bcc-acd9-79f213c7da55 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.143668 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 6ee7533c-cce1-4c6b-a77b-020ee68933f1 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:02.244671 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Allocated IP 172.20.0.1 (6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce/03d9b81e-6504-49f1-9d77-32a1bea3505d/e96e55d4-96d9-437e-bca4-339bc79c6188) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:55:02.247367 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2ea25526-8aa5-4bcc-acd9-79f213c7da55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.306928 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:55:02.431254 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2ea25526-8aa5-4bcc-acd9-79f213c7da55 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.460052 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2ea25526-8aa5-4bcc-acd9-79f213c7da55 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.466847 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-2ea25526-8aa5-4bcc-acd9-79f213c7da55 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/6d0b1696-db48-4041-8a08-7e1798c0d059 HTTP/1.1" status: 204 len: 168 time: 0.9590256 Nov 12 14:55:02.489460 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52410) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:02.576438 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:02.577049 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.601242 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.610910 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ea25526-8aa5-4bcc-acd9-79f213c7da55 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6d0b1696-db48-4041-8a08-7e1798c0d059,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:02.693135 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.781301 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.826360 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6208c67b-11d2-4ac7-aa7a-6de805656c74']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:02.854288 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '76703328-5110-41f6-99fd-a8b8776599f5') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:02.854874 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '76703328-5110-41f6-99fd-a8b8776599f5') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:02.888932 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:00Z', 'revision_number': 3, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:54:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:02.920896 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.928524 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Checking router: a08d9f45-c652-4276-867c-ab77c8f81aef for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:55:02.928874 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Updating router a08d9f45-c652-4276-867c-ab77c8f81aef port 28e0c573-48d9-421d-be0b-6000eb77163c binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:55:02.972915 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:02.993756 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.167003 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52426) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:03.208923 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0a045097-0183-4d1d-87ac-ae3618e84a5a req-51ab74bd-bdf2-4052-80a4-296da566b1d3 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.3079805 Nov 12 14:55:03.224681 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.233422 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] Releasing vlan 641 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 14:55:03.233804 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 14:55:03.235451 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 14:55:03.292411 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.347335 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Pushing event updated for resources: {'Port': ['ID=e96e55d4-96d9-437e-bca4-339bc79c6188,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:03.370441 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:55:03.372316 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:03.375223 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:55:03.378886 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.397678 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Allocated IP 172.20.0.1 (cf063ae4-6fb7-44b8-9c9f-984a39a87f66/f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2/ceb62b38-4fa2-461d-8699-99ddeedd36fb) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:55:03.405219 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.411759 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] 10.222.0.61 "DELETE /v2.0/networks/6208c67b-11d2-4ac7-aa7a-6de805656c74 HTTP/1.1" status: 204 len: 168 time: 0.9177060 Nov 12 14:55:03.422702 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5700daf5-518f-4119-b4e8-d1f9e8e63bbd admin admin] Pushing event deleted for resources: {'Network': ['ID=6208c67b-11d2-4ac7-aa7a-6de805656c74,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:03.442863 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.511266 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-358ff1f2-f6ff-4a3e-9560-ee8968e71154 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.512390 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.519268 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.611532 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Attempting to bind port 28e0c573-48d9-421d-be0b-6000eb77163c on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:55:03.612222 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Attempting to bind port 28e0c573-48d9-421d-be0b-6000eb77163c by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:55:03.612328 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Attempting to bind port 28e0c573-48d9-421d-be0b-6000eb77163c on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:03.616044 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b35b81-a0b4-4316-898e-7bd48432a189 None None] Pushing event updated for resources: {'Port': ['ID=28e0c573-48d9-421d-be0b-6000eb77163c,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:03.621529 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 54, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:55:03.621825 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:55:03.622487 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.622741 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.623258 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:55:03.623909 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Bound port: 28e0c573-48d9-421d-be0b-6000eb77163c, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:55:03.624917 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.650939 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52442) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:03.722503 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] For port 28e0c573-48d9-421d-be0b-6000eb77163c, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:55:03.726504 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] For port 28e0c573-48d9-421d-be0b-6000eb77163c, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=28e0c573-48d9-421d-be0b-6000eb77163c,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:55:03.731012 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.783297 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:55:03.783936 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:54:54Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:03.792924 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.799941 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b31869c1-697d-4d47-9d25-1bd8f42a60ae admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=7f28b8acd9314945ab72867be957f076&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1410129 Nov 12 14:55:03.800706 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52446) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:03.811120 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.819043 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-358ff1f2-f6ff-4a3e-9560-ee8968e71154 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.862391 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-358ff1f2-f6ff-4a3e-9560-ee8968e71154 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.896694 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:55:03.901088 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:55:03.923863 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:03.935549 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:55:03.936017 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:03.945864 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Pushing event updated for resources: {'Port': ['ID=ceb62b38-4fa2-461d-8699-99ddeedd36fb,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:03.981516 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-358ff1f2-f6ff-4a3e-9560-ee8968e71154 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7885ecbc-2c0c-46aa-98e8-01c4494aaab0,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:03.990597 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-358ff1f2-f6ff-4a3e-9560-ee8968e71154 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=22856e7706aa4ef7a65c34eb039f701c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.8222289 Nov 12 14:55:04.002267 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52450) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:04.120900 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:04.150844 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f4163789-9421-45c3-8ee6-e41be6e59aa3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.173901 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.183663 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7428717'] for port, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.188331 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b35b81-a0b4-4316-898e-7bd48432a189 None None] Pushing event updated for resources: {'Port': ['ID=28e0c573-48d9-421d-be0b-6000eb77163c,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:04.234577 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f4163789-9421-45c3-8ee6-e41be6e59aa3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.246834 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:04.249682 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.317061 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ef0bcd4-0958-45be-a004-b39a0aee0f91 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.351316 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.384487 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.395464 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.403713 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ef0bcd4-0958-45be-a004-b39a0aee0f91 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.422997 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-740976c4-3598-4c65-8438-c3af09f97ee2 None None] Provisioning complete for port ceb62b38-4fa2-461d-8699-99ddeedd36fb triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:04.423367 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-740976c4-3598-4c65-8438-c3af09f97ee2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.425207 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Pushing event updated for resources: {'Port': ['ID=e96e55d4-96d9-437e-bca4-339bc79c6188,revision_number=2']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:04.462022 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f4163789-9421-45c3-8ee6-e41be6e59aa3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.463641 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-740976c4-3598-4c65-8438-c3af09f97ee2 None None] Port ceb62b38-4fa2-461d-8699-99ddeedd36fb cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:55:04.464613 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f4163789-9421-45c3-8ee6-e41be6e59aa3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.465749 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f4163789-9421-45c3-8ee6-e41be6e59aa3 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/433970e3-9639-4c7f-a918-ba91e4121bf0 HTTP/1.1" status: 204 len: 168 time: 0.6588316 Nov 12 14:55:04.479945 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:04.486677 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4163789-9421-45c3-8ee6-e41be6e59aa3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=433970e3-9639-4c7f-a918-ba91e4121bf0,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:04.490789 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:00Z', 'revision_number': 3, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:04.512336 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.517694 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:55:04.533159 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4dcb5e58-e192-4caf-8ed7-9052be091ba6 req-0f4e9e0d-ac73-4783-8c90-1236bcc7302f tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.1695156 Nov 12 14:55:04.547275 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:04.599443 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b46101da-20e4-4960-868b-e07603b83e8f None None] The sync data for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi is: [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:00Z', 'revision_number': 3, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:55:04.622790 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ef0bcd4-0958-45be-a004-b39a0aee0f91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.625429 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ef0bcd4-0958-45be-a004-b39a0aee0f91 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.626599 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-8ef0bcd4-0958-45be-a004-b39a0aee0f91 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/7885ecbc-2c0c-46aa-98e8-01c4494aaab0 HTTP/1.1" status: 204 len: 168 time: 0.6224480 Nov 12 14:55:04.665655 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ef0bcd4-0958-45be-a004-b39a0aee0f91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7885ecbc-2c0c-46aa-98e8-01c4494aaab0,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:04.730526 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:04.783018 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.787060 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Router 987f2aa3-654a-4bf7-92e0-07095fb78d18 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 14:55:04.804763 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.805684 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.917177 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:04.944167 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Pushing event updated for resources: {'Port': ['ID=ceb62b38-4fa2-461d-8699-99ddeedd36fb,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:05.051152 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:55:05.059432 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-92bf6df3-3331-4fd3-8667-ab22b09662e4 admin admin] 10.222.0.61 "PUT /v2.0/routers/987f2aa3-654a-4bf7-92e0-07095fb78d18/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.1874192 Nov 12 14:55:05.070709 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Sync routers for ids ['987f2aa3-654a-4bf7-92e0-07095fb78d18'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:55:05.090608 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Routers {'987f2aa3-654a-4bf7-92e0-07095fb78d18'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:55:05.091459 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:54:54Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['987f2aa3-654a-4bf7-92e0-07095fb78d18'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:05.091802 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:55:05.094534 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:05.289202 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52500) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:05.331479 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-00204f57-c81a-4409-8ba9-a10c288c3b57 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:05.396389 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52508) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:05.475834 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Set router 987f2aa3-654a-4bf7-92e0-07095fb78d18 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:55:05.513684 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-4360e36a-3f1e-4c23-aad1-d610bcc088eb None None] Provisioning complete for port ceb62b38-4fa2-461d-8699-99ddeedd36fb triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:05.515880 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4360e36a-3f1e-4c23-aad1-d610bcc088eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:05.518875 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Router a08d9f45-c652-4276-867c-ab77c8f81aef has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 14:55:05.643281 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-00204f57-c81a-4409-8ba9-a10c288c3b57 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:05.650002 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-00204f57-c81a-4409-8ba9-a10c288c3b57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:05.652559 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-4785d6fd-8812-4901-99b5-d67a87d7da50 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=f3baad2f70454e6ead6ef2f2c94ab874&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2542162 Nov 12 14:55:05.654591 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52518) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:05.685157 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-4360e36a-3f1e-4c23-aad1-d610bcc088eb None None] Port ceb62b38-4fa2-461d-8699-99ddeedd36fb cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:55:05.721107 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00204f57-c81a-4409-8ba9-a10c288c3b57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9c60e15-da12-4e41-8e9d-d6d70e8dd3e7,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:05.766391 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-00204f57-c81a-4409-8ba9-a10c288c3b57 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=67e0d0b1bd1b42f695cd92a9e19063f6&name=default HTTP/1.1" status: 200 len: 2995 time: 0.4754689 Nov 12 14:55:05.777579 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52524) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:05.969269 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-63ae8e7e-9eb8-43a1-9247-c419de12e852 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.054149 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-63ae8e7e-9eb8-43a1-9247-c419de12e852 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.130628 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.86', 53852) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:06.131448 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e05a54f4-cf7e-4613-b810-e8895ccd43e9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.171112 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138'}], 'enable_snat': True}, 'gw_port_id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:55Z', 'updated_at': '2021-11-12T14:55:03Z', 'revision_number': 4, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'gw_port': {'id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:31:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e96e55d4-96d9-437e-bca4-339bc79c6188', 'name': '', 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'mac_address': 'fa:16:3e:30:01:7d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '03d9b81e-6504-49f1-9d77-32a1bea3505d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:01Z', 'updated_at': '2021-11-12T14:55:03Z', 'revision_number': 2, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'subnets': [{'id': '03d9b81e-6504-49f1-9d77-32a1bea3505d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:06.210473 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 28e0c573-48d9-421d-be0b-6000eb77163c up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:06.226633 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-805e583e-16a5-401a-a971-b738230eb0a5 req-7d25edc0-d44c-41e7-90b2-1a345e26c711 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.2186763 Nov 12 14:55:06.273891 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Checking router: 987f2aa3-654a-4bf7-92e0-07095fb78d18 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:55:06.281676 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Updating router 987f2aa3-654a-4bf7-92e0-07095fb78d18 port e96e55d4-96d9-437e-bca4-339bc79c6188 binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:55:06.287301 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:55:06.302534 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d0e937be-bcb0-43dc-8e5b-e64fd3fdf970 admin admin] 10.222.0.61 "PUT /v2.0/routers/a08d9f45-c652-4276-867c-ab77c8f81aef/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6949856 Nov 12 14:55:06.351972 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 28e0c573-48d9-421d-be0b-6000eb77163c triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:06.354140 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.362837 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52540) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:06.368702 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.512216 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e05a54f4-cf7e-4613-b810-e8895ccd43e9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.562243 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-63ae8e7e-9eb8-43a1-9247-c419de12e852 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.567802 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-63ae8e7e-9eb8-43a1-9247-c419de12e852 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.571191 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-63ae8e7e-9eb8-43a1-9247-c419de12e852 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f9c60e15-da12-4e41-8e9d-d6d70e8dd3e7 HTTP/1.1" status: 204 len: 168 time: 0.7900887 Nov 12 14:55:06.655085 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ae8e7e-9eb8-43a1-9247-c419de12e852 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9c60e15-da12-4e41-8e9d-d6d70e8dd3e7,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:06.659257 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f6259631-e170-4af6-975e-ca8e0a9df4db admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.780988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.807506 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port 28e0c573-48d9-421d-be0b-6000eb77163c, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=28e0c573-48d9-421d-be0b-6000eb77163c,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:06.815076 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.816133 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:06.919471 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21255210-6730-4071-96d9-4096a52abbeb req-4cee104f-fc19-4d68-b1c0-05b255532b22 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:06.939272 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-4cee104f-fc19-4d68-b1c0-05b255532b22 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.86 "GET /v2.0/networks?id=c99d116e-3040-4028-8675-ad12dd87958d HTTP/1.1" status: 200 len: 812 time: 0.8055356 Nov 12 14:55:06.982662 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f6259631-e170-4af6-975e-ca8e0a9df4db admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:06.989392 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f6259631-e170-4af6-975e-ca8e0a9df4db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.006039 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=28e0c573-48d9-421d-be0b-6000eb77163c,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:07.068309 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:07.069121 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Request body: {'port': {'device_id': '689a1fb3-9828-439c-a3c6-d5c86bbfe89a', 'network_id': 'c99d116e-3040-4028-8675-ad12dd87958d', 'admin_state_up': True, 'tenant_id': 'c5cd628706954cf7a4c6ff4180751364'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:07.076311 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.104864 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f6259631-e170-4af6-975e-ca8e0a9df4db admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e0dfc847844f44acb1e01709d0d37ba5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7404747 Nov 12 14:55:07.111659 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52584) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:07.153141 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6259631-e170-4af6-975e-ca8e0a9df4db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa40c909-5d13-4cbf-a076-b9887522da60,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:07.224484 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e05a54f4-cf7e-4613-b810-e8895ccd43e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.228969 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e05a54f4-cf7e-4613-b810-e8895ccd43e9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.234521 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e05a54f4-cf7e-4613-b810-e8895ccd43e9 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/a98d5ef7-a9a9-4a51-b20b-dd1d76e28c86 HTTP/1.1" status: 204 len: 168 time: 1.5377054 Nov 12 14:55:07.293454 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52596) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:07.324534 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.329032 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-32234bd9-de69-4810-8404-64786a265d27 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2110545913', 'description': 'tempest-description--1706144239'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:07.334148 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.397134 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b6baa4e8-e4ab-4336-a580-98eda4cffa6c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.427238 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd792c56-228e-460f-a801-23e6434b57fe None None] Pushing event updated for resources: {'Port': ['ID=e96e55d4-96d9-437e-bca4-339bc79c6188,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:07.496213 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Attempting to bind port e96e55d4-96d9-437e-bca4-339bc79c6188 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:55:07.496847 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Attempting to bind port e96e55d4-96d9-437e-bca4-339bc79c6188 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:55:07.497382 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Attempting to bind port e96e55d4-96d9-437e-bca4-339bc79c6188 on network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:07.501544 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b6baa4e8-e4ab-4336-a580-98eda4cffa6c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.505286 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 54, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:55:07.508758 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Checking segment: {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:55:07.509349 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.509903 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Bound using segment: {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:55:07.510565 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Bound port: e96e55d4-96d9-437e-bca4-339bc79c6188, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:55:07.511129 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.588701 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Sync routers for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:55:07.602869 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:55:07.603523 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:54:54Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:07.621339 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] For port e96e55d4-96d9-437e-bca4-339bc79c6188, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:55:07.627417 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] For port e96e55d4-96d9-437e-bca4-339bc79c6188, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=e96e55d4-96d9-437e-bca4-339bc79c6188,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:55:07.638721 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:07.753457 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Routers {'987f2aa3-654a-4bf7-92e0-07095fb78d18'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:55:07.755575 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:54:54Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['987f2aa3-654a-4bf7-92e0-07095fb78d18'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:07.885845 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd792c56-228e-460f-a801-23e6434b57fe None None] Pushing event updated for resources: {'Port': ['ID=e96e55d4-96d9-437e-bca4-339bc79c6188,revision_number=4']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:07.919476 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:55:07.958564 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6360a2db-6792-4fa8-bb2c-11b0a2bb590f req-ff33b6cb-01df-4f1f-b173-afe286a9bd9f tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.0891778 Nov 12 14:55:08.010152 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-32234bd9-de69-4810-8404-64786a265d27 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.033649 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b6baa4e8-e4ab-4336-a580-98eda4cffa6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.067472 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e05a54f4-cf7e-4613-b810-e8895ccd43e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a98d5ef7-a9a9-4a51-b20b-dd1d76e28c86,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:08.073590 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b6baa4e8-e4ab-4336-a580-98eda4cffa6c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.076888 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b6baa4e8-e4ab-4336-a580-98eda4cffa6c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/aa40c909-5d13-4cbf-a076-b9887522da60 HTTP/1.1" status: 204 len: 168 time: 0.9596012 Nov 12 14:55:08.104229 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6baa4e8-e4ab-4336-a580-98eda4cffa6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa40c909-5d13-4cbf-a076-b9887522da60,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:08.139712 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] Set router 987f2aa3-654a-4bf7-92e0-07095fb78d18 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:55:08.173464 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 28e0c573-48d9-421d-be0b-6000eb77163c up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:08.217206 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Made reservation on behalf of c5cd628706954cf7a4c6ff4180751364 for: {'port': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:55:08.224370 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.255110 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-a16a0363-74f2-4439-98c1-09ce02447bd3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:08.262672 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-a16a0363-74f2-4439-98c1-09ce02447bd3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 818 time: 1.3223922 Nov 12 14:55:08.293041 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-e2644f73-da3d-43b1-b6ea-4119202ac81a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/quotas/2040ee65b5fa46299ec3a2b82d7464ff HTTP/1.1" status: 200 len: 375 time: 0.0246625 Nov 12 14:55:08.364796 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-32234bd9-de69-4810-8404-64786a265d27 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.373030 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-32234bd9-de69-4810-8404-64786a265d27 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.453617 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-32234bd9-de69-4810-8404-64786a265d27 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.455528 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-32234bd9-de69-4810-8404-64786a265d27 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.1465878 Nov 12 14:55:08.459850 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52662) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:08.466652 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-a1d0ede9-4123-4c76-91b7-182a77d33d84 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'security_group_rule': {'security_group_id': 'ca2a62a9-52f5-4a03-a51d-b483a8433480', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:08.499804 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32234bd9-de69-4810-8404-64786a265d27 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ca2a62a9-52f5-4a03-a51d-b483a8433480,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:08.542876 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a1d0ede9-4123-4c76-91b7-182a77d33d84 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.760507 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-7119c964-94d5-4afb-aacb-d92c4546d499 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4202430 Nov 12 14:55:08.803494 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138'}], 'enable_snat': True}, 'gw_port_id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:55Z', 'updated_at': '2021-11-12T14:55:03Z', 'revision_number': 4, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'gw_port': {'id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:31:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e96e55d4-96d9-437e-bca4-339bc79c6188', 'name': '', 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'mac_address': 'fa:16:3e:30:01:7d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '03d9b81e-6504-49f1-9d77-32a1bea3505d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:01Z', 'updated_at': '2021-11-12T14:55:07Z', 'revision_number': 4, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'subnets': [{'id': '03d9b81e-6504-49f1-9d77-32a1bea3505d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:08.821902 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a1d0ede9-4123-4c76-91b7-182a77d33d84 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.829564 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a1d0ede9-4123-4c76-91b7-182a77d33d84 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.869984 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Allocated IP 172.20.0.13 (c99d116e-3040-4028-8675-ad12dd87958d/dd2d4dae-b732-4123-90af-8645300420da/1f15370a-838b-414a-9824-824840a9315d) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:55:08.890277 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d0ede9-4123-4c76-91b7-182a77d33d84 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a993499b-facc-4a67-ac1c-5f87ecb19e3c,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:08.925413 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 28e0c573-48d9-421d-be0b-6000eb77163c triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:08.926733 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.934043 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58e45c3e-f182-46cd-8ca2-cc1d69dd57cd None None] The sync data for ids ['987f2aa3-654a-4bf7-92e0-07095fb78d18'] in dv-cinder-776422-5-iscsi is: [{'id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138'}], 'enable_snat': True}, 'gw_port_id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:55Z', 'updated_at': '2021-11-12T14:55:03Z', 'revision_number': 4, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'gw_port': {'id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:31:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e96e55d4-96d9-437e-bca4-339bc79c6188', 'name': '', 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'mac_address': 'fa:16:3e:30:01:7d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '03d9b81e-6504-49f1-9d77-32a1bea3505d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:01Z', 'updated_at': '2021-11-12T14:55:07Z', 'revision_number': 4, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'subnets': [{'id': '03d9b81e-6504-49f1-9d77-32a1bea3505d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:55:08.936859 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a1d0ede9-4123-4c76-91b7-182a77d33d84 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:08.945794 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-a1d0ede9-4123-4c76-91b7-182a77d33d84 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4844000 Nov 12 14:55:08.948469 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52670) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:08.955908 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-cef9d7fb-312c-4f59-90f3-021edd31267c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'security_group_rule': {'security_group_id': 'ca2a62a9-52f5-4a03-a51d-b483a8433480', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:09.046352 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cef9d7fb-312c-4f59-90f3-021edd31267c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.165977 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 2, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:09.299884 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Checking router: a08d9f45-c652-4276-867c-ab77c8f81aef for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:55:09.309776 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3ea65473-162d-4739-8bfc-c39773c5df2d req-b59e1cff-6c71-48dd-b452-aaaea1de6b6c tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.0798199 Nov 12 14:55:09.310025 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Updating router a08d9f45-c652-4276-867c-ab77c8f81aef port ceb62b38-4fa2-461d-8699-99ddeedd36fb binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:55:09.335007 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cef9d7fb-312c-4f59-90f3-021edd31267c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.342104 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cef9d7fb-312c-4f59-90f3-021edd31267c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.387834 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef9d7fb-312c-4f59-90f3-021edd31267c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=24751ca7-51dc-4925-9703-9a19338ed03c,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:09.407470 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cef9d7fb-312c-4f59-90f3-021edd31267c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.412325 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-cef9d7fb-312c-4f59-90f3-021edd31267c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4598670 Nov 12 14:55:09.414545 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52686) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:09.425045 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'floatingip': {'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:09.460362 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.480517 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.482435 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52688) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:09.495854 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.565479 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1f996bea-4748-40ff-bde7-23d15a9be4b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.826379 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1f996bea-4748-40ff-bde7-23d15a9be4b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.848023 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1f996bea-4748-40ff-bde7-23d15a9be4b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:09.982823 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:10.077578 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52706) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:10.104702 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:10.164015 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device e96e55d4-96d9-437e-bca4-339bc79c6188 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:10.191761 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Network c99d116e-3040-4028-8675-ad12dd87958d is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:55:10.198754 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Pushing event updated for resources: {'Port': ['ID=1f15370a-838b-414a-9824-824840a9315d,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:10.212053 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:10.258234 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-1f996bea-4748-40ff-bde7-23d15a9be4b1 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=4a41a7061cd147dea49800a8e0abcf0d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7718265 Nov 12 14:55:10.260202 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 52718) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:10.260947 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f996bea-4748-40ff-bde7-23d15a9be4b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22277f3a-8054-4148-b40f-de8ffd3008e3,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:10.384443 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:55:10.490957 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port e96e55d4-96d9-437e-bca4-339bc79c6188 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:10.493860 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:10.500038 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Allocated IP 172.27.3.9 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/5d7463a2-a60f-4f0f-a412-d028fe77defe) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:55:10.511279 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-958aa084-34c5-4e08-81f0-e6ed00e0b013 service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101617) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:55:10.513556 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-958aa084-34c5-4e08-81f0-e6ed00e0b013 service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3170588 Nov 12 14:55:10.533204 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-890205a8-8341-4ac7-9596-0a8e21d88e02 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:10.680711 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:10.681375 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for port, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:10.725634 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-890205a8-8341-4ac7-9596-0a8e21d88e02 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:10.797619 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:10.800933 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-c8164394-8650-4386-b701-7a2fc541c72d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.7638795 Nov 12 14:55:10.858144 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-7c345044-bf1e-48af-b4d1-b815134e960b tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101617) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:55:10.858144 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-7c345044-bf1e-48af-b4d1-b815134e960b tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.86 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0185485 Nov 12 14:55:10.858144 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-489f48aa-3dc5-4e0b-aca1-30fad4396531 service neutron] 10.222.0.61 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3065305 Nov 12 14:55:10.901780 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:10.938690 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.005646 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.055305 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.059703 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab88ff53-cf22-4c08-b05c-31e06b26e010 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.064291 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d278a3-12e3-40b2-8b4b-04fe665c91dc None None] Pushing event updated for resources: {'Port': ['ID=ceb62b38-4fa2-461d-8699-99ddeedd36fb,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:11.102772 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-c0666359-c7a8-491a-b8c6-00cf47a8e2bd service neutron] 10.222.0.61 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2625687 Nov 12 14:55:11.136323 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-890205a8-8341-4ac7-9596-0a8e21d88e02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.141007 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-890205a8-8341-4ac7-9596-0a8e21d88e02 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.142175 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-890205a8-8341-4ac7-9596-0a8e21d88e02 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/22277f3a-8054-4148-b40f-de8ffd3008e3 HTTP/1.1" status: 204 len: 168 time: 0.8662372 Nov 12 14:55:11.183687 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-890205a8-8341-4ac7-9596-0a8e21d88e02 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22277f3a-8054-4148-b40f-de8ffd3008e3,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:11.328522 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port e96e55d4-96d9-437e-bca4-339bc79c6188, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=e96e55d4-96d9-437e-bca4-339bc79c6188,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:11.404218 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.439854 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Attempting to bind port ceb62b38-4fa2-461d-8699-99ddeedd36fb on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:55:11.440628 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Attempting to bind port ceb62b38-4fa2-461d-8699-99ddeedd36fb by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:55:11.441915 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Attempting to bind port ceb62b38-4fa2-461d-8699-99ddeedd36fb on network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:11.456239 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:55:11.480713 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 54, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:55:11.481569 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Checking segment: {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:55:11.482187 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'Port': ['ID=5d7463a2-a60f-4f0f-a412-d028fe77defe,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:11.482459 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.483261 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Bound using segment: {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:55:11.484019 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Bound port: ceb62b38-4fa2-461d-8699-99ddeedd36fb, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:55:11.484680 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.509514 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:11.537852 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:55:11.541601 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-55a03d68-6798-44cc-8026-c2140a926016 None None] Provisioning complete for port ceb62b38-4fa2-461d-8699-99ddeedd36fb triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:11.542149 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-55a03d68-6798-44cc-8026-c2140a926016 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.597827 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=e96e55d4-96d9-437e-bca4-339bc79c6188,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:11.599318 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd3c174-642b-43ee-a71f-e4286243dde5 req-7911c315-75d8-4a66-857c-1bbf3e6c2ae0 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:11.631896 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5fd3c174-642b-43ee-a71f-e4286243dde5 req-7911c315-75d8-4a66-857c-1bbf3e6c2ae0 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 932 time: 0.7407253 Nov 12 14:55:11.733726 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-55a03d68-6798-44cc-8026-c2140a926016 None None] Port ceb62b38-4fa2-461d-8699-99ddeedd36fb cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:55:11.812886 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-970d089c-8e63-4508-8f48-ffeb22c6af37 req-905d2969-ce68-4d25-8682-6d0091757698 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 210 time: 0.0757735 Nov 12 14:55:11.885511 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] For port ceb62b38-4fa2-461d-8699-99ddeedd36fb, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:55:11.890066 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] For port ceb62b38-4fa2-461d-8699-99ddeedd36fb, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=ceb62b38-4fa2-461d-8699-99ddeedd36fb,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:55:11.915812 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:11.987814 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:55:11.989075 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:54:54Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:12.155658 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5fd3c174-642b-43ee-a71f-e4286243dde5 req-849f78aa-5f74-43e9-8758-60d1dd380caa tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5205858 Nov 12 14:55:12.191121 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:12.330863 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab88ff53-cf22-4c08-b05c-31e06b26e010 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:12.354810 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:12.361425 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab88ff53-cf22-4c08-b05c-31e06b26e010 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:12.419860 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Request body: {'port': {'device_id': '689a1fb3-9828-439c-a3c6-d5c86bbfe89a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:12.614479 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:12.618341 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device e96e55d4-96d9-437e-bca4-339bc79c6188 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:12.625785 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d278a3-12e3-40b2-8b4b-04fe665c91dc None None] Pushing event updated for resources: {'Port': ['ID=ceb62b38-4fa2-461d-8699-99ddeedd36fb,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:12.655543 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-ab88ff53-cf22-4c08-b05c-31e06b26e010 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=ff37346de58d47499566393a3104f825&name=default HTTP/1.1" status: 200 len: 2996 time: 2.5716400 Nov 12 14:55:12.666520 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 52798) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:12.733142 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab88ff53-cf22-4c08-b05c-31e06b26e010 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09607a84-e3c5-450f-8177-3a6764d302dd,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:12.817258 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-def8ea9c-1073-4809-8a1f-3557b233fafa None None] Provisioning complete for port ceb62b38-4fa2-461d-8699-99ddeedd36fb triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:12.817953 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-def8ea9c-1073-4809-8a1f-3557b233fafa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:12.986428 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:55:13.195560 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-def8ea9c-1073-4809-8a1f-3557b233fafa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:13.244813 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:13.267696 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:13.282387 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port e96e55d4-96d9-437e-bca4-339bc79c6188 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:13.282621 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:13.486124 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:13.556063 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8fa98936-c531-4c57-8a8a-efb3dd8e123a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:13.653012 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:13.677907 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 4.2593267 Nov 12 14:55:13.686278 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1fd8bf-d992-4297-87c1-5365cd7b2f77 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'Port': ['ID=5d7463a2-a60f-4f0f-a412-d028fe77defe,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:13.737183 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3f027b32-5e5e-416a-bb62-704bbc57f9d3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:13.742987 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3f027b32-5e5e-416a-bb62-704bbc57f9d3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 818 time: 0.7240074 Nov 12 14:55:13.805575 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8fa98936-c531-4c57-8a8a-efb3dd8e123a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:13.813605 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-ff512472-231a-49e1-92d6-26687a77a24f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/quotas/2040ee65b5fa46299ec3a2b82d7464ff HTTP/1.1" status: 200 len: 375 time: 0.0653582 Nov 12 14:55:14.003616 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb8c59a-d85c-4338-87b0-4b4ecbd80f83 req-ad1d38f2-c252-456f-ad89-00412ee83a79 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:14.005698 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0fb8c59a-d85c-4338-87b0-4b4ecbd80f83 req-ad1d38f2-c252-456f-ad89-00412ee83a79 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 932 time: 0.6873329 Nov 12 14:55:14.006983 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8fa98936-c531-4c57-8a8a-efb3dd8e123a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:14.007350 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-def8ea9c-1073-4809-8a1f-3557b233fafa None None] For port ceb62b38-4fa2-461d-8699-99ddeedd36fb, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=ceb62b38-4fa2-461d-8699-99ddeedd36fb,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:14.010292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8fa98936-c531-4c57-8a8a-efb3dd8e123a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:14.011580 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-8fa98936-c531-4c57-8a8a-efb3dd8e123a admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/09607a84-e3c5-450f-8177-3a6764d302dd HTTP/1.1" status: 204 len: 168 time: 1.3438103 Nov 12 14:55:14.044849 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fa98936-c531-4c57-8a8a-efb3dd8e123a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09607a84-e3c5-450f-8177-3a6764d302dd,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:14.163618 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-def8ea9c-1073-4809-8a1f-3557b233fafa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:14.268282 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0fb8c59a-d85c-4338-87b0-4b4ecbd80f83 req-5aadf85b-9ee1-4b96-b00b-6c560b27c387 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2146692 Nov 12 14:55:14.447768 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-def8ea9c-1073-4809-8a1f-3557b233fafa None None] Pushing event updated for resources: {'Port': ['ID=ceb62b38-4fa2-461d-8699-99ddeedd36fb,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:14.507338 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:11Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:14.623057 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-be6e4234-7200-4b3d-aaf2-e0a72ea4788f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&fields=id HTTP/1.1" status: 200 len: 255 time: 0.7918634 Nov 12 14:55:14.633161 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff0d2d70-d3a7-4ac9-bead-22173750e2cf None None] The sync data for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi is: [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:11Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:55:14.679668 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-45d9ab20-e8e0-4b93-9df9-194a83bf2616 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-securitygroup--2110545913&fields=id&tenant_id=e9ecca05e4af49c9b46cc186e0517c9c HTTP/1.1" status: 200 len: 267 time: 0.1535513 Nov 12 14:55:15.025543 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f15370a-838b-414a-9824-824840a9315d {{(pid=101617) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:55:15.084594 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Publish callbacks [] for port, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:15.146023 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-cc10e66a-b4ba-4b22-984f-1249a9b8b492 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:15.156058 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-cc10e66a-b4ba-4b22-984f-1249a9b8b492 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 811 time: 0.4333251 Nov 12 14:55:15.167068 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-21faab91-108e-4869-80fc-727dd8978c89 service neutron] 10.222.0.61 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5288992 Nov 12 14:55:15.205365 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-00a04877-c0e4-4511-a3ea-80e46031794d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/quotas/e9ecca05e4af49c9b46cc186e0517c9c HTTP/1.1" status: 200 len: 375 time: 0.0475194 Nov 12 14:55:15.421864 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-90a6b9f5-43c1-4352-a93a-bea538d0822e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2136285 Nov 12 14:55:15.454025 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-b93672cb-ce61-47ee-84d3-6090ff743173 service neutron] 10.222.0.61 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2850125 Nov 12 14:55:15.465282 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.provisioning_blocks [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Transition to ACTIVE for port object 1f15370a-838b-414a-9824-824840a9315d will not be triggered until provisioned by entity L2. {{(pid=101617) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:55:15.470869 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7428717'] for port, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:15.544756 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.86', 53868) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:16.070782 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Pushing event updated for resources: {'Port': ['ID=1f15370a-838b-414a-9824-824840a9315d,revision_number=2']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:16.102946 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-c9fdea28-559e-46eb-beed-d8df4ec5d32a service neutron] 10.222.0.61 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6688819 Nov 12 14:55:16.181643 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-10028fd6-3dbc-44ac-8efb-6ae0c3b04061 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:16.183988 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-10028fd6-3dbc-44ac-8efb-6ae0c3b04061 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.86 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 818 time: 0.6379435 Nov 12 14:55:16.226930 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Request body: {'port': {'device_id': '50446844-a322-466f-b059-0a36b7993f9e', 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce', 'admin_state_up': True, 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:16.359671 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.managers [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Attempting to bind port 1f15370a-838b-414a-9824-824840a9315d on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101617) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:55:16.360337 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.managers [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Attempting to bind port 1f15370a-838b-414a-9824-824840a9315d by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '596317c1-3ea0-41df-b1b0-0fd9146ab825', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'c99d116e-3040-4028-8675-ad12dd87958d'}] {{(pid=101617) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:55:16.360964 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Attempting to bind port 1f15370a-838b-414a-9824-824840a9315d on network c99d116e-3040-4028-8675-ad12dd87958d {{(pid=101617) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:16.415782 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c672ee-9e01-4c5e-8a1b-eab7e5ebf3cd req-8492f358-059a-4cf2-9ddb-27705346efa8 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:16.418381 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-73c672ee-9e01-4c5e-8a1b-eab7e5ebf3cd req-8492f358-059a-4cf2-9ddb-27705346efa8 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 944 time: 0.2928648 Nov 12 14:55:16.422393 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Port 1f15370a-838b-414a-9824-824840a9315d on network c99d116e-3040-4028-8675-ad12dd87958d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101617) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:55:16.423134 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Attempting to bind port 1f15370a-838b-414a-9824-824840a9315d on network c99d116e-3040-4028-8675-ad12dd87958d {{(pid=101617) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:16.444366 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 55, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101617) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:55:16.446223 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Checking segment: {'id': '596317c1-3ea0-41df-b1b0-0fd9146ab825', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'c99d116e-3040-4028-8675-ad12dd87958d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:55:16.447496 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Bound using segment: {'id': '596317c1-3ea0-41df-b1b0-0fd9146ab825', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'c99d116e-3040-4028-8675-ad12dd87958d'} {{(pid=101617) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:55:16.450023 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.managers [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Bound port: 1f15370a-838b-414a-9824-824840a9315d, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '596317c1-3ea0-41df-b1b0-0fd9146ab825', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 636, 'network_id': 'c99d116e-3040-4028-8675-ad12dd87958d'}}] {{(pid=101617) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:55:16.450572 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:16.504597 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-95577a39-13ba-4def-aba4-57c135a92d03 service neutron] 10.222.0.61 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3890307 Nov 12 14:55:16.668466 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Made reservation on behalf of 2040ee65b5fa46299ec3a2b82d7464ff for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:55:16.678247 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:16.727092 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device ceb62b38-4fa2-461d-8699-99ddeedd36fb up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:16.909481 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] For port 1f15370a-838b-414a-9824-824840a9315d, host hv-cinder-77642, cleared binding levels {{(pid=101617) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:55:16.932373 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] For port 1f15370a-838b-414a-9824-824840a9315d, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1f15370a-838b-414a-9824-824840a9315d,segment=NetworkSegment(596317c1-3ea0-41df-b1b0-0fd9146ab825),segment_id=596317c1-3ea0-41df-b1b0-0fd9146ab825)] {{(pid=101617) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:55:16.948297 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7428717'] for port, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:16.951325 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port ceb62b38-4fa2-461d-8699-99ddeedd36fb triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:16.958696 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:17.090697 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:17.095327 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for port, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:17.097206 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] 10.222.0.86 "PUT /v2.0/ports/1f15370a-838b-414a-9824-824840a9315d HTTP/1.1" status: 200 len: 1094 time: 5.5518475 Nov 12 14:55:17.098525 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '689a1fb3-9828-439c-a3c6-d5c86bbfe89a', 'tag': '1f15370a-838b-414a-9824-824840a9315d'}] {{(pid=101617) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:55:17.152453 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-73c672ee-9e01-4c5e-8a1b-eab7e5ebf3cd req-32c4e5b7-a010-4195-80cc-2e836a5b89fc tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7077653 Nov 12 14:55:17.351753 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-88dcae0f-bd07-45ac-8b88-7231df612e66 req-4b7231a3-c292-41e7-b699-bea552563108 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 210 time: 0.2083197 Nov 12 14:55:17.528643 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a89741189a1474522a3f12d6512a4dfa907db76ed85a3c525a03538a87d7317" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1067bb66-581b-4b77-9364-beda926bd390" -d '{"events": [{"name": "network-changed", "server_uuid": "689a1fb3-9828-439c-a3c6-d5c86bbfe89a", "tag": "1f15370a-838b-414a-9824-824840a9315d"}]}' {{(pid=101617) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:55:17.556327 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5586282b-3c7a-4ab7-9a32-066ea10f9c8a service neutron] Pushing event updated for resources: {'Port': ['ID=1f15370a-838b-414a-9824-824840a9315d,revision_number=3']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:17.621099 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2262787f-62ff-4f06-8a6c-7e125d3d769f req-902f2372-dc31-4fb1-9cc1-6214e4895dc7 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 210 time: 0.1146071 Nov 12 14:55:17.662894 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21255210-6730-4071-96d9-4096a52abbeb req-1a4515d5-67a6-4cf8-9354-6cf503516008 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:17.667784 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-1a4515d5-67a6-4cf8-9354-6cf503516008 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c5cd628706954cf7a4c6ff4180751364&device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 1097 time: 0.3512094 Nov 12 14:55:17.811860 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Allocated IP 172.20.0.7 (6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce/03d9b81e-6504-49f1-9d77-32a1bea3505d/c0d8b239-ac45-4bde-b0fd-049dd324ae18) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:55:17.858023 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-45143d89-fe18-4ba4-910d-3175577fdd16 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=1f15370a-838b-414a-9824-824840a9315d HTTP/1.1" status: 200 len: 217 time: 0.1619601 Nov 12 14:55:18.013303 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:55:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2ae7370c-a82c-4bf4-8ac9-14c734640841 x-openstack-request-id: req-2ae7370c-a82c-4bf4-8ac9-14c734640841 {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:55:18.013645 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "689a1fb3-9828-439c-a3c6-d5c86bbfe89a", "tag": "1f15370a-838b-414a-9824-824840a9315d", "status": "completed", "code": 200}]} {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:55:18.013820 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-2ae7370c-a82c-4bf4-8ac9-14c734640841 {{(pid=101617) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:55:18.014287 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '689a1fb3-9828-439c-a3c6-d5c86bbfe89a', 'tag': '1f15370a-838b-414a-9824-824840a9315d', 'status': 'completed', 'code': 200} Nov 12 14:55:18.108578 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21255210-6730-4071-96d9-4096a52abbeb req-7866aa05-b72b-4bad-af27-48b868f21b6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:18.119031 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-7866aa05-b72b-4bad-af27-48b868f21b6a service neutron] 10.222.0.86 "GET /v2.0/subnets?id=dd2d4dae-b732-4123-90af-8645300420da HTTP/1.1" status: 200 len: 852 time: 0.1293094 Nov 12 14:55:18.136561 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:18.179003 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:18.358881 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-66228c7c-4746-43d9-8415-8a22763e4bcb service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c99d116e-3040-4028-8675-ad12dd87958d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1125491 Nov 12 14:55:18.385852 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:55:18.390311 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:18.392634 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Pushing event updated for resources: {'Port': ['ID=c0d8b239-ac45-4bde-b0fd-049dd324ae18,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:18.404268 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:55:18.413530 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:18.414505 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:18.448489 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-b53a1f80-daf6-4283-a6a7-af9ba8c3bc41 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2276328 Nov 12 14:55:18.479141 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Request body: {'port': {'device_id': '50446844-a322-466f-b059-0a36b7993f9e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:18.673780 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-d33c7fc8-8e02-487a-8866-ecd455009284 service neutron] 10.222.0.86 "GET /v2.0/networks/c99d116e-3040-4028-8675-ad12dd87958d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2347765 Nov 12 14:55:18.766592 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b4312f39-2955-4f03-b9c8-c06fd66d1d99 req-7da1b217-6b0e-414b-8af7-78f4c78902ac tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 210 time: 0.1169758 Nov 12 14:55:18.775375 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.86', 53876) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:18.791175 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:18.837747 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78a799da-d4e1-4414-84c8-16475b5bb7c9 req-58c154ac-774c-4d4b-ae9f-ce949717efa5 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:18.844210 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-78a799da-d4e1-4414-84c8-16475b5bb7c9 req-58c154ac-774c-4d4b-ae9f-ce949717efa5 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 944 time: 0.4815629 Nov 12 14:55:18.876756 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 53074) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:19.046995 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-78a799da-d4e1-4414-84c8-16475b5bb7c9 req-f0b5071f-7521-43f6-9440-2c5b16a00d87 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1273224 Nov 12 14:55:19.100765 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-21255210-6730-4071-96d9-4096a52abbeb req-b7c7fe7c-5ae7-4e0f-bb43-2cfc8e070900 service neutron] 10.222.0.86 "GET /v2.0/networks/c99d116e-3040-4028-8675-ad12dd87958d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3962011 Nov 12 14:55:19.273397 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-8e5bf90d-06f5-4527-b2e4-8927bdb5830e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:19.288001 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-8e5bf90d-06f5-4527-b2e4-8927bdb5830e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.86 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 818 time: 0.4682772 Nov 12 14:55:19.360989 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98c94064-3971-4c03-9dec-8a19e3bd8ebb req-c06d1d84-0d26-43f3-adb1-91accbb10fa0 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 210 time: 0.1348603 Nov 12 14:55:19.393654 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Request body: {'port': {'device_id': '79a36c2e-a840-40bd-aaf3-6b40146ff2c5', 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce', 'admin_state_up': True, 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:19.416772 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1067bb66-581b-4b77-9364-beda926bd390 req-62daf7f4-fe5c-44c6-a9ca-942cfc77bda7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:19.418888 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1067bb66-581b-4b77-9364-beda926bd390 req-62daf7f4-fe5c-44c6-a9ca-942cfc77bda7 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c5cd628706954cf7a4c6ff4180751364&device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 1097 time: 0.1299121 Nov 12 14:55:19.603274 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-694eac67-9113-43d0-9344-9f466f52ab47 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:19.962777 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Made reservation on behalf of 2040ee65b5fa46299ec3a2b82d7464ff for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:55:19.966796 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:19.970431 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c5dacedf-ac95-46e7-a263-364d7490c3d8 req-6bc382c7-2ccf-425a-94c3-0fb95a2ab02d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 210 time: 0.0746820 Nov 12 14:55:20.004077 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c0d8b239-ac45-4bde-b0fd-049dd324ae18 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:55:20.016314 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:20.040794 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-694eac67-9113-43d0-9344-9f466f52ab47 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:20.059095 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-694eac67-9113-43d0-9344-9f466f52ab47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:20.120359 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Transition to ACTIVE for port object c0d8b239-ac45-4bde-b0fd-049dd324ae18 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:55:20.224145 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:20.339965 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:55:20.343603 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f5a7ee2-f9c3-4110-9f5e-e2c115b0c535 req-091868e4-623d-4ad7-8ae1-04410c646c18 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:20.345206 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0f5a7ee2-f9c3-4110-9f5e-e2c115b0c535 req-091868e4-623d-4ad7-8ae1-04410c646c18 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 944 time: 0.1026437 Nov 12 14:55:20.365987 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-694eac67-9113-43d0-9344-9f466f52ab47 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=05a2df9851ed4248b656e5077f38e6ef&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4853308 Nov 12 14:55:20.371811 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53130) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:20.399998 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-694eac67-9113-43d0-9344-9f466f52ab47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3e7876c-884d-4a56-b43d-da3d8ea8e30f,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:20.545249 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-91ac4151-ebf7-4e00-a316-3049aa0271b5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:20.554381 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0f5a7ee2-f9c3-4110-9f5e-e2c115b0c535 req-17f7f63c-ae59-4dc7-a373-a9840f65424b tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1971407 Nov 12 14:55:20.560766 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Pushing event updated for resources: {'Port': ['ID=c0d8b239-ac45-4bde-b0fd-049dd324ae18,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:20.593446 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-91ac4151-ebf7-4e00-a316-3049aa0271b5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:20.656916 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-91ac4151-ebf7-4e00-a316-3049aa0271b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:20.660296 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-91ac4151-ebf7-4e00-a316-3049aa0271b5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:20.661554 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-91ac4151-ebf7-4e00-a316-3049aa0271b5 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f3e7876c-884d-4a56-b43d-da3d8ea8e30f HTTP/1.1" status: 204 len: 168 time: 0.2876370 Nov 12 14:55:20.669926 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ac4151-ebf7-4e00-a316-3049aa0271b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3e7876c-884d-4a56-b43d-da3d8ea8e30f,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:20.831072 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4064464f-059e-4818-9587-ca816d547f3d req-e58898a4-ba44-4e27-909b-1144430f1ab9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 210 time: 0.3045506 Nov 12 14:55:20.847421 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Attempting to bind port c0d8b239-ac45-4bde-b0fd-049dd324ae18 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:55:20.847778 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Attempting to bind port c0d8b239-ac45-4bde-b0fd-049dd324ae18 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:55:20.848471 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Attempting to bind port c0d8b239-ac45-4bde-b0fd-049dd324ae18 on network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:20.855672 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Allocated IP 172.20.0.4 (6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce/03d9b81e-6504-49f1-9d77-32a1bea3505d/116218b4-72d9-40d7-bcaf-24faa7227810) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:55:20.858864 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Port c0d8b239-ac45-4bde-b0fd-049dd324ae18 on network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:55:20.859179 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Attempting to bind port c0d8b239-ac45-4bde-b0fd-049dd324ae18 on network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:20.874101 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 55, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:55:20.874863 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Checking segment: {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:55:20.875732 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Bound using segment: {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:55:20.876431 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Bound port: c0d8b239-ac45-4bde-b0fd-049dd324ae18, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:55:20.877092 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:20.974057 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53150) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:21.116208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] For port c0d8b239-ac45-4bde-b0fd-049dd324ae18, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:55:21.123620 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fc2e9c88-cb25-490d-aadc-f6ea2ab9b417 req-2ae8f5c5-f24c-491c-b57c-19566b1d0dfc tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 210 time: 0.0432374 Nov 12 14:55:21.188162 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] For port c0d8b239-ac45-4bde-b0fd-049dd324ae18, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:55:21.198220 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.207236 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.214371 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f64ec1d9-f216-4d0d-8c89-634af04e9802 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.319966 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:21.320887 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.322382 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] 10.222.0.86 "PUT /v2.0/ports/c0d8b239-ac45-4bde-b0fd-049dd324ae18 HTTP/1.1" status: 200 len: 1093 time: 2.8488698 Nov 12 14:55:21.324586 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '50446844-a322-466f-b059-0a36b7993f9e', 'tag': 'c0d8b239-ac45-4bde-b0fd-049dd324ae18'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:55:21.333602 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53162) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:21.349943 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7bea487d-4fa9-4342-864d-f51f320d889c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.374613 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f64ec1d9-f216-4d0d-8c89-634af04e9802 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.383725 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f64ec1d9-f216-4d0d-8c89-634af04e9802 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.418308 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec409c7b-a161-487d-98e7-41653ed289fc service neutron] Pushing event updated for resources: {'Port': ['ID=c0d8b239-ac45-4bde-b0fd-049dd324ae18,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:21.441128 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.448887 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f64ec1d9-f216-4d0d-8c89-634af04e9802 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=35b9d819b5634b6c8a9f397ce0ff75f0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4710274 Nov 12 14:55:21.451883 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53168) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:21.463663 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f64ec1d9-f216-4d0d-8c89-634af04e9802 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e562b4d-cb34-4ba5-b183-9a2f7c3e6f63,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:21.528900 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Pushing event updated for resources: {'Port': ['ID=116218b4-72d9-40d7-bcaf-24faa7227810,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:21.543074 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7bea487d-4fa9-4342-864d-f51f320d889c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.547048 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:55:21.549083 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:21.550964 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7bea487d-4fa9-4342-864d-f51f320d889c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.553961 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:55:21.555671 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1206fd3a-4428-4ce7-bc2e-2b8cd6b7e9d7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.568298 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:21.569123 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.614566 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1206fd3a-4428-4ce7-bc2e-2b8cd6b7e9d7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.624956 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bea487d-4fa9-4342-864d-f51f320d889c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e2f45d1-480f-40b7-aeb5-cc7fdb6b73c2,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:21.630445 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-3d4a6cdf-97bd-4d60-b7fc-e34ad2b1435a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3156180 Nov 12 14:55:21.633650 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-7bea487d-4fa9-4342-864d-f51f320d889c admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=56b87f48438a4aacad191e778582b991&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2987843 Nov 12 14:55:21.634566 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 53174) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:21.688749 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1206fd3a-4428-4ce7-bc2e-2b8cd6b7e9d7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.692520 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1206fd3a-4428-4ce7-bc2e-2b8cd6b7e9d7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.697155 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-1206fd3a-4428-4ce7-bc2e-2b8cd6b7e9d7 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/3e562b4d-cb34-4ba5-b183-9a2f7c3e6f63 HTTP/1.1" status: 204 len: 168 time: 0.2423153 Nov 12 14:55:21.712600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c0540a8f-502b-49fa-967b-fa7d8e456047" -d '{"events": [{"name": "network-changed", "server_uuid": "50446844-a322-466f-b059-0a36b7993f9e", "tag": "c0d8b239-ac45-4bde-b0fd-049dd324ae18"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:55:21.712831 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1206fd3a-4428-4ce7-bc2e-2b8cd6b7e9d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e562b4d-cb34-4ba5-b183-9a2f7c3e6f63,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:21.780961 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce25252-0964-4227-a8d1-ea75791fe56f req-94a0f1ca-7f5e-4e23-b90c-e4babe0f440e tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:21.782512 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fce25252-0964-4227-a8d1-ea75791fe56f req-94a0f1ca-7f5e-4e23-b90c-e4babe0f440e tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 944 time: 0.1116486 Nov 12 14:55:21.820206 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d926089d-91fc-41c3-8cc1-775dfaa0740d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:21.863949 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fce25252-0964-4227-a8d1-ea75791fe56f req-419f706f-5b65-4274-8adf-7c7f1c1f0078 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694542 Nov 12 14:55:21.912246 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d926089d-91fc-41c3-8cc1-775dfaa0740d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.008693 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2a820c39-ddbd-4b44-9c17-bc805941b0e3 req-3ae7eee4-7dce-459b-ba7a-553107d62e85 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 210 time: 0.0438108 Nov 12 14:55:22.010235 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:55:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31b7c987-f66a-408e-8919-100906126ce5 x-openstack-request-id: req-31b7c987-f66a-408e-8919-100906126ce5 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:55:22.010543 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "50446844-a322-466f-b059-0a36b7993f9e", "tag": "c0d8b239-ac45-4bde-b0fd-049dd324ae18", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:55:22.010797 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-31b7c987-f66a-408e-8919-100906126ce5 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:55:22.011322 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '50446844-a322-466f-b059-0a36b7993f9e', 'tag': 'c0d8b239-ac45-4bde-b0fd-049dd324ae18', 'status': 'completed', 'code': 200} Nov 12 14:55:22.037439 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d926089d-91fc-41c3-8cc1-775dfaa0740d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.040536 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d926089d-91fc-41c3-8cc1-775dfaa0740d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.048946 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d926089d-91fc-41c3-8cc1-775dfaa0740d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/2e2f45d1-480f-40b7-aeb5-cc7fdb6b73c2 HTTP/1.1" status: 204 len: 168 time: 0.4128563 Nov 12 14:55:22.063657 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d926089d-91fc-41c3-8cc1-775dfaa0740d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e2f45d1-480f-40b7-aeb5-cc7fdb6b73c2,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:22.107986 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-21a99eea-91ae-4031-a644-fdffa4cbe057 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.250387 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c10cbe44-fc8b-440e-aa90-67a41090c3eb req-3f1bae1d-7503-4ad9-bfce-a8193f9080e2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:22.258055 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c10cbe44-fc8b-440e-aa90-67a41090c3eb req-3f1bae1d-7503-4ad9-bfce-a8193f9080e2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 931 time: 0.0593886 Nov 12 14:55:22.364707 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c10cbe44-fc8b-440e-aa90-67a41090c3eb req-8f19c2bf-8b56-4d1b-8010-1fd3824e1fbd tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822453 Nov 12 14:55:22.432300 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 53200) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:22.454854 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-45f39568-359f-4a42-8e0a-7a36b68bc580 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.548643 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-45f39568-359f-4a42-8e0a-7a36b68bc580 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.554512 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-45f39568-359f-4a42-8e0a-7a36b68bc580 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.597176 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-45f39568-359f-4a42-8e0a-7a36b68bc580 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=8d62aa7c6d5a4e1599fab092afa0f2e6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1635234 Nov 12 14:55:22.598080 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f39568-359f-4a42-8e0a-7a36b68bc580 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c3c8857-6bf7-4f02-b055-361399a13d7d,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:22.600376 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53210) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:22.668715 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-788414a2-b4bc-4edb-b80e-758050ab5753 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.690339 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-788414a2-b4bc-4edb-b80e-758050ab5753 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.743728 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-788414a2-b4bc-4edb-b80e-758050ab5753 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.746515 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-788414a2-b4bc-4edb-b80e-758050ab5753 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:22.747759 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-788414a2-b4bc-4edb-b80e-758050ab5753 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/9c3c8857-6bf7-4f02-b055-361399a13d7d HTTP/1.1" status: 204 len: 168 time: 0.1462841 Nov 12 14:55:22.756430 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-788414a2-b4bc-4edb-b80e-758050ab5753 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c3c8857-6bf7-4f02-b055-361399a13d7d,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:23.058229 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79af8622-fb5a-46ea-810b-cba842c05476 req-3206663b-533e-4d59-8457-b4b27a133c64 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:23.059826 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-79af8622-fb5a-46ea-810b-cba842c05476 req-3206663b-533e-4d59-8457-b4b27a133c64 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 944 time: 0.0621879 Nov 12 14:55:23.115834 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-79af8622-fb5a-46ea-810b-cba842c05476 req-1d8bf371-f2f6-41bf-8473-a0fc4b51c1b0 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500176 Nov 12 14:55:23.138040 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-25d6c94f-e6f0-42a2-9135-f0040a10f895 req-e94aa1b3-4a24-4833-954f-a9259d0df069 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 210 time: 0.0466976 Nov 12 14:55:23.372122 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Request body: {'port': {'device_id': '79a36c2e-a840-40bd-aaf3-6b40146ff2c5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:23.616605 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.86', 53887) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:23.742120 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1067bb66-581b-4b77-9364-beda926bd390 req-4610d1e7-6892-4ca2-8f9f-3aee1d9c0610 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:23.746237 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1067bb66-581b-4b77-9364-beda926bd390 req-4610d1e7-6892-4ca2-8f9f-3aee1d9c0610 service neutron] 10.222.0.86 "GET /v2.0/networks?id=c99d116e-3040-4028-8675-ad12dd87958d HTTP/1.1" status: 200 len: 913 time: 0.3946593 Nov 12 14:55:23.871875 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:23.878396 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0540a8f-502b-49fa-967b-fa7d8e456047 req-e17919b0-9334-4639-9140-ab6462a3c88f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:23.880465 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c0540a8f-502b-49fa-967b-fa7d8e456047 req-e17919b0-9334-4639-9140-ab6462a3c88f service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1096 time: 0.4775229 Nov 12 14:55:23.890728 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1067bb66-581b-4b77-9364-beda926bd390 req-12ee1204-6c49-494b-8d2b-fb5af37cdb41 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=1f15370a-838b-414a-9824-824840a9315d HTTP/1.1" status: 200 len: 217 time: 0.1180911 Nov 12 14:55:24.163147 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14bc0cb7-f301-48a3-a370-73be5218a9a6 req-3aa7263f-ac03-437f-ab52-4d9143c6133d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:24.164745 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-14bc0cb7-f301-48a3-a370-73be5218a9a6 req-3aa7263f-ac03-437f-ab52-4d9143c6133d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 931 time: 0.7090607 Nov 12 14:55:24.256287 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1067bb66-581b-4b77-9364-beda926bd390 req-99c9041b-e6e5-4bab-b448-065084dee350 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:24.263425 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1067bb66-581b-4b77-9364-beda926bd390 req-99c9041b-e6e5-4bab-b448-065084dee350 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=dd2d4dae-b732-4123-90af-8645300420da HTTP/1.1" status: 200 len: 852 time: 0.3717649 Nov 12 14:55:24.350545 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1067bb66-581b-4b77-9364-beda926bd390 req-c8ea9216-ba4a-4da4-9922-ea4308a8c9a2 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c99d116e-3040-4028-8675-ad12dd87958d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0795307 Nov 12 14:55:24.400852 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-34773684-3d94-40f4-8c14-c34856d60157 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:24.402332 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-34773684-3d94-40f4-8c14-c34856d60157 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 811 time: 0.7587192 Nov 12 14:55:24.408208 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2a5eacd-c225-4d77-9b31-3733d8da9c58 req-0b22ac6a-b29f-4abe-aacc-8f350cd5f466 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:24.416665 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b2a5eacd-c225-4d77-9b31-3733d8da9c58 req-0b22ac6a-b29f-4abe-aacc-8f350cd5f466 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 944 time: 0.1490724 Nov 12 14:55:24.530989 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-aa3b86fc-d5d7-4e32-8aea-86f89e96020b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:24.543296 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b2a5eacd-c225-4d77-9b31-3733d8da9c58 req-e516c041-5fce-4fe4-a23c-f5704c05d8b6 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1206164 Nov 12 14:55:24.558278 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1067bb66-581b-4b77-9364-beda926bd390 req-35230d77-9847-4304-b358-e34204179752 service neutron] 10.222.0.86 "GET /v2.0/networks/c99d116e-3040-4028-8675-ad12dd87958d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1975231 Nov 12 14:55:24.661946 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0540a8f-502b-49fa-967b-fa7d8e456047 req-36668c8a-927c-4a7e-a5dd-20cdae03f9b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:24.663407 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c0540a8f-502b-49fa-967b-fa7d8e456047 req-36668c8a-927c-4a7e-a5dd-20cdae03f9b3 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&shared=False HTTP/1.1" status: 200 len: 919 time: 0.7418199 Nov 12 14:55:24.701873 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4d996862-d7bc-4b2a-bd5f-e839de1ed54b req-dbfbc611-cc62-4955-ad7a-68c6ea892519 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 210 time: 0.0356817 Nov 12 14:55:24.703755 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-14bc0cb7-f301-48a3-a370-73be5218a9a6 req-d0719d74-7a01-452a-8f64-73c036030c05 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5024416 Nov 12 14:55:24.723764 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-12f60e61-e97c-49cf-987d-630048119443 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e9ecca05e4af49c9b46cc186e0517c9c HTTP/1.1" status: 200 len: 380 time: 0.2615898 Nov 12 14:55:24.753633 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1067bb66-581b-4b77-9364-beda926bd390 req-09ed9346-9e44-4dc6-a6f5-b23d3571989a service neutron] 10.222.0.86 "GET /v2.0/networks/c99d116e-3040-4028-8675-ad12dd87958d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1884434 Nov 12 14:55:24.795816 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'port': {'device_id': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'admin_state_up': True, 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'security_groups': ['ca2a62a9-52f5-4a03-a51d-b483a8433480']}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:25.203520 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0540a8f-502b-49fa-967b-fa7d8e456047 req-4b73c2ae-5fde-4619-89a3-88203ad056de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:25.204998 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c0540a8f-502b-49fa-967b-fa7d8e456047 req-4b73c2ae-5fde-4619-89a3-88203ad056de service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5290625 Nov 12 14:55:25.250767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 116218b4-72d9-40d7-bcaf-24faa7227810 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:55:25.259393 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:25.262225 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Made reservation on behalf of e9ecca05e4af49c9b46cc186e0517c9c for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:55:25.265798 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:25.289867 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Transition to ACTIVE for port object 116218b4-72d9-40d7-bcaf-24faa7227810 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:55:25.298459 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:25.501483 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Pushing event updated for resources: {'Port': ['ID=116218b4-72d9-40d7-bcaf-24faa7227810,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:25.501998 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:25.540632 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Attempting to bind port 116218b4-72d9-40d7-bcaf-24faa7227810 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:55:25.541135 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Attempting to bind port 116218b4-72d9-40d7-bcaf-24faa7227810 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:55:25.541667 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Attempting to bind port 116218b4-72d9-40d7-bcaf-24faa7227810 on network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:25.561343 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Port 116218b4-72d9-40d7-bcaf-24faa7227810 on network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:55:25.561829 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Attempting to bind port 116218b4-72d9-40d7-bcaf-24faa7227810 on network 6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:25.573637 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 55, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:55:25.574288 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Checking segment: {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:55:25.574774 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Bound using segment: {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:55:25.575710 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Bound port: 116218b4-72d9-40d7-bcaf-24faa7227810, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '38b1dcbf-888a-4fe0-aecf-902b01be2bc6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:55:25.576512 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:25.628372 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Allocated IP 172.20.0.10 (cf063ae4-6fb7-44b8-9c9f-984a39a87f66/f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2/6404f751-2813-4de0-aa94-89a7df49823a) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:55:25.792562 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] For port 116218b4-72d9-40d7-bcaf-24faa7227810, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:55:25.793609 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54dcc70b-ef1d-4118-8d79-d07254d18020 req-096515c9-61f4-4cfb-978f-8de96181cf51 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:25.802956 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-54dcc70b-ef1d-4118-8d79-d07254d18020 req-096515c9-61f4-4cfb-978f-8de96181cf51 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 944 time: 0.1114891 Nov 12 14:55:25.803214 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] For port 116218b4-72d9-40d7-bcaf-24faa7227810, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=116218b4-72d9-40d7-bcaf-24faa7227810,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:55:25.825717 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:25.876828 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-54dcc70b-ef1d-4118-8d79-d07254d18020 req-372f4777-b0bf-4e3c-96c8-947c3607c041 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714076 Nov 12 14:55:25.974788 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:25.975715 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:25.978095 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] 10.222.0.86 "PUT /v2.0/ports/116218b4-72d9-40d7-bcaf-24faa7227810 HTTP/1.1" status: 200 len: 1093 time: 2.6136181 Nov 12 14:55:25.982904 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '79a36c2e-a840-40bd-aaf3-6b40146ff2c5', 'tag': '116218b4-72d9-40d7-bcaf-24faa7227810'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:55:25.986932 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-261814e2-8aa4-4e3b-8a02-659bced1d6fe" -d '{"events": [{"name": "network-changed", "server_uuid": "79a36c2e-a840-40bd-aaf3-6b40146ff2c5", "tag": "116218b4-72d9-40d7-bcaf-24faa7227810"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:55:26.037783 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cdbb9151-e2c7-45df-9fda-31004fc02f03 req-0caaa20b-6ed1-465a-a745-a4641b698802 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 210 time: 0.0765777 Nov 12 14:55:26.093662 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc9e22de-f9b2-4ec1-adf8-ba73de945802 service neutron] Pushing event updated for resources: {'Port': ['ID=116218b4-72d9-40d7-bcaf-24faa7227810,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:26.117062 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0972c8e5-3a00-41dc-bd50-e17b556c404a req-bf7ac993-ffe1-4e6c-89fc-9101f19ae996 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:26.127100 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0972c8e5-3a00-41dc-bd50-e17b556c404a req-bf7ac993-ffe1-4e6c-89fc-9101f19ae996 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.1135457 Nov 12 14:55:26.143307 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:26.177428 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0972c8e5-3a00-41dc-bd50-e17b556c404a req-bb4415f5-b2aa-4846-9af5-c977afe7233d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492754 Nov 12 14:55:26.200940 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:26.250783 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:55:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7d7b1d29-0484-415d-969b-bc276f4d09ec x-openstack-request-id: req-7d7b1d29-0484-415d-969b-bc276f4d09ec {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:55:26.251121 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "79a36c2e-a840-40bd-aaf3-6b40146ff2c5", "tag": "116218b4-72d9-40d7-bcaf-24faa7227810", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:55:26.251467 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-7d7b1d29-0484-415d-969b-bc276f4d09ec {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:55:26.251975 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '79a36c2e-a840-40bd-aaf3-6b40146ff2c5', 'tag': '116218b4-72d9-40d7-bcaf-24faa7227810', 'status': 'completed', 'code': 200} Nov 12 14:55:26.261455 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:55:26.264864 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:55:26.270229 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:55:26.276558 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:26.277180 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:26.289299 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'Port': ['ID=6404f751-2813-4de0-aa94-89a7df49823a,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:26.295703 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7219b08f-3052-4636-8600-5cdb61651283 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5039275 Nov 12 14:55:26.516563 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-5d0bc061-65b2-46e7-91e4-fa26140d160f None None] Provisioning complete for port 6404f751-2813-4de0-aa94-89a7df49823a triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:26.517081 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5d0bc061-65b2-46e7-91e4-fa26140d160f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:26.553297 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-5d0bc061-65b2-46e7-91e4-fa26140d160f None None] Port 6404f751-2813-4de0-aa94-89a7df49823a cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:55:26.896863 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:26.989803 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7937bcc1-08c1-40ab-b738-8e44b99b3190 req-9fcc7560-b197-44c3-966e-b32f03ea7022 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:26.991336 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7937bcc1-08c1-40ab-b738-8e44b99b3190 req-9fcc7560-b197-44c3-966e-b32f03ea7022 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 944 time: 0.0498586 Nov 12 14:55:27.040148 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7937bcc1-08c1-40ab-b738-8e44b99b3190 req-23458f82-f33d-4352-b614-a6f06d51e0e1 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427172 Nov 12 14:55:27.190750 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c1715a-fd9e-4ade-99a8-9ce54b94ca1d req-dfc7413c-34ec-4f91-9369-40de2071c2f5 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:27.192264 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-08c1715a-fd9e-4ade-99a8-9ce54b94ca1d req-dfc7413c-34ec-4f91-9369-40de2071c2f5 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 932 time: 0.0514700 Nov 12 14:55:27.248373 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-08c1715a-fd9e-4ade-99a8-9ce54b94ca1d req-c57b479b-de31-4f62-a7fe-a4633514287d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499132 Nov 12 14:55:27.294148 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8397c9-e95b-4d0e-bc15-35b4bb087f0c req-73eff001-dc3f-49e8-a12d-8a2f9025533b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:27.295530 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-bc8397c9-e95b-4d0e-bc15-35b4bb087f0c req-73eff001-dc3f-49e8-a12d-8a2f9025533b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.0483110 Nov 12 14:55:27.347427 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-bc8397c9-e95b-4d0e-bc15-35b4bb087f0c req-a438f9cf-1f27-44a7-80ad-cde30672dff9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452085 Nov 12 14:55:27.521615 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1f15370a-838b-414a-9824-824840a9315d details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:55:27.529537 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Request body: {'port': {'device_id': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:27.630048 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 1f15370a-838b-414a-9824-824840a9315d, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1f15370a-838b-414a-9824-824840a9315d,segment=NetworkSegment(596317c1-3ea0-41df-b1b0-0fd9146ab825),segment_id=596317c1-3ea0-41df-b1b0-0fd9146ab825)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:27.642865 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '1f15370a-838b-414a-9824-824840a9315d', 'network_id': 'c99d116e-3040-4028-8675-ad12dd87958d', 'port_id': '1f15370a-838b-414a-9824-824840a9315d', 'mac_address': 'fa:16:3e:32:80:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 636, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'dd2d4dae-b732-4123-90af-8645300420da', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:55:27.663586 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:27.676839 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-8d4a8108-48e8-47b4-a0e8-21b53fc5b845 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:27.678356 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-8d4a8108-48e8-47b4-a0e8-21b53fc5b845 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1096 time: 0.1532328 Nov 12 14:55:27.681753 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261814e2-8aa4-4e3b-8a02-659bced1d6fe req-3a391e48-d320-4d83-aa32-e23a3e7a019b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:27.683208 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-261814e2-8aa4-4e3b-8a02-659bced1d6fe req-3a391e48-d320-4d83-aa32-e23a3e7a019b service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 1096 time: 0.1060221 Nov 12 14:55:27.685613 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:27.701601 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f15370a-838b-414a-9824-824840a9315d {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:55:27.725057 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 1f15370a-838b-414a-9824-824840a9315d, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1f15370a-838b-414a-9824-824840a9315d,segment=NetworkSegment(596317c1-3ea0-41df-b1b0-0fd9146ab825),segment_id=596317c1-3ea0-41df-b1b0-0fd9146ab825)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:27.730031 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:27.778687 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=1f15370a-838b-414a-9824-824840a9315d,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:27.821372 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-5c16640d-8e36-46c8-bebb-ffabfca10c2b service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18 HTTP/1.1" status: 200 len: 217 time: 0.1076796 Nov 12 14:55:27.882949 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:28.001698 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-0a905084-efc7-4594-98dd-629fca5a1b96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:28.003661 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-0a905084-efc7-4594-98dd-629fca5a1b96 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 200 len: 858 time: 0.1502275 Nov 12 14:55:28.028885 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261814e2-8aa4-4e3b-8a02-659bced1d6fe req-53d010e5-df6b-43fb-a1c5-4a62e3419c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:28.030339 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-261814e2-8aa4-4e3b-8a02-659bced1d6fe req-53d010e5-df6b-43fb-a1c5-4a62e3419c06 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&shared=False HTTP/1.1" status: 200 len: 919 time: 0.3156800 Nov 12 14:55:28.178832 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6404f751-2813-4de0-aa94-89a7df49823a {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:55:28.187516 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:28.203099 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e7ae66-cab7-4449-872d-d0413e416464 req-8916c08c-75dc-44a4-8736-2c422956afe2 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:28.204609 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d2e7ae66-cab7-4449-872d-d0413e416464 req-8916c08c-75dc-44a4-8736-2c422956afe2 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 945 time: 0.0916426 Nov 12 14:55:28.218362 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Transition to ACTIVE for port object 6404f751-2813-4de0-aa94-89a7df49823a will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:55:28.227164 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:28.303296 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Pushing event updated for resources: {'Port': ['ID=6404f751-2813-4de0-aa94-89a7df49823a,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:28.311332 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d2e7ae66-cab7-4449-872d-d0413e416464 req-a1c34d84-d955-45bc-b042-e99a1872cdc5 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1000876 Nov 12 14:55:28.341553 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Attempting to bind port 6404f751-2813-4de0-aa94-89a7df49823a on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:55:28.341884 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Attempting to bind port 6404f751-2813-4de0-aa94-89a7df49823a by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:55:28.342207 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Attempting to bind port 6404f751-2813-4de0-aa94-89a7df49823a on network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:28.347079 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Port 6404f751-2813-4de0-aa94-89a7df49823a on network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:55:28.347402 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Attempting to bind port 6404f751-2813-4de0-aa94-89a7df49823a on network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:55:28.352579 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 55, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:55:28.352908 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Checking segment: {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:55:28.353321 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Bound using segment: {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:55:28.353703 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Bound port: 6404f751-2813-4de0-aa94-89a7df49823a, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:55:28.354053 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:28.415032 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f66f6c-c1db-4c3a-872f-277ca46c686b req-11e6d2da-6cda-4353-95f0-8666a7f5be9a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:28.422531 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-98f66f6c-c1db-4c3a-872f-277ca46c686b req-11e6d2da-6cda-4353-95f0-8666a7f5be9a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 944 time: 0.0784361 Nov 12 14:55:28.437962 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] For port 6404f751-2813-4de0-aa94-89a7df49823a, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:55:28.465728 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] For port 6404f751-2813-4de0-aa94-89a7df49823a, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=6404f751-2813-4de0-aa94-89a7df49823a,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:55:28.467681 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-98f66f6c-c1db-4c3a-872f-277ca46c686b req-0c972d6f-87af-4777-80f3-acc4caf50eb5 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440485 Nov 12 14:55:28.471382 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:28.516098 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:28.516732 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:28.518124 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] 10.222.0.86 "PUT /v2.0/ports/6404f751-2813-4de0-aa94-89a7df49823a HTTP/1.1" status: 200 len: 1094 time: 0.9943550 Nov 12 14:55:28.520694 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'tag': '6404f751-2813-4de0-aa94-89a7df49823a'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:55:28.523176 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1838412b-38aa-42de-aeb9-6b85b743f1de" -d '{"events": [{"name": "network-changed", "server_uuid": "750b2499-ec22-4102-9133-f6a0fdb713d0", "tag": "6404f751-2813-4de0-aa94-89a7df49823a"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:55:28.543738 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3260e175-c95f-43ab-a008-0a9bac61ed7d req-48164305-64d4-4133-b4b1-7182dee80383 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:28.545331 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3260e175-c95f-43ab-a008-0a9bac61ed7d req-48164305-64d4-4133-b4b1-7182dee80383 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.1226978 Nov 12 14:55:28.566195 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:55:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-300c9cba-c5af-4ae5-a322-43d3413bb050 x-openstack-request-id: req-300c9cba-c5af-4ae5-a322-43d3413bb050 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:55:28.566470 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "750b2499-ec22-4102-9133-f6a0fdb713d0", "tag": "6404f751-2813-4de0-aa94-89a7df49823a", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:55:28.566712 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-300c9cba-c5af-4ae5-a322-43d3413bb050 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:55:28.567091 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'tag': '6404f751-2813-4de0-aa94-89a7df49823a', 'status': 'completed', 'code': 200} Nov 12 14:55:28.568703 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88ac5cd4-56cc-440e-986f-364a361a6b22 service neutron] Pushing event updated for resources: {'Port': ['ID=6404f751-2813-4de0-aa94-89a7df49823a,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:28.607421 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3260e175-c95f-43ab-a008-0a9bac61ed7d req-f4be4186-aea6-4bf7-be6d-f9d6148fce55 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505679 Nov 12 14:55:29.429505 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6586108-b1e1-41e7-8517-d26cbba76efe req-eaeb7131-3e36-444a-b275-77956a9f1117 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:29.430938 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e6586108-b1e1-41e7-8517-d26cbba76efe req-eaeb7131-3e36-444a-b275-77956a9f1117 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 945 time: 0.0473120 Nov 12 14:55:29.477986 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e6586108-b1e1-41e7-8517-d26cbba76efe req-74b507c5-0c0b-42e3-9320-bba186a931d5 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407195 Nov 12 14:55:29.596889 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79bcc724-d494-4ba2-a593-737b3d44752e req-c5fe6b91-2203-4c11-a6fb-27176f613b4d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:29.598031 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-79bcc724-d494-4ba2-a593-737b3d44752e req-c5fe6b91-2203-4c11-a6fb-27176f613b4d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 944 time: 0.0494378 Nov 12 14:55:29.645345 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-79bcc724-d494-4ba2-a593-737b3d44752e req-c938532a-7776-41ca-9cdc-a26175465fad tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412221 Nov 12 14:55:29.724455 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978d509f-4195-402c-b338-63c3bb442c73 req-74b887b6-a2fe-4f4d-a97f-62106efb0bcc tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:29.725948 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-978d509f-4195-402c-b338-63c3bb442c73 req-74b887b6-a2fe-4f4d-a97f-62106efb0bcc tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.0516663 Nov 12 14:55:29.772456 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-978d509f-4195-402c-b338-63c3bb442c73 req-23dfc8cf-cda0-4e07-935a-0715c875ee5a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401826 Nov 12 14:55:30.592515 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff4acdc-8caf-4752-b0e0-ff34b8f572f0 req-7bc1b027-b954-4854-b1d4-677466ed1958 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:30.593963 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7ff4acdc-8caf-4752-b0e0-ff34b8f572f0 req-7bc1b027-b954-4854-b1d4-677466ed1958 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 945 time: 0.0488579 Nov 12 14:55:30.765180 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d1416d-0036-4d41-8437-9c4037491a29 req-ac052320-cc5b-40e8-ba84-893be74cf98a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:30.766746 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-74d1416d-0036-4d41-8437-9c4037491a29 req-ac052320-cc5b-40e8-ba84-893be74cf98a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 944 time: 0.0515580 Nov 12 14:55:30.790375 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['1f15370a-838b-414a-9824-824840a9315d'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:55:30.845417 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-74d1416d-0036-4d41-8437-9c4037491a29 req-c440b47b-fd4f-4654-8412-1779fd3eba75 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678375 Nov 12 14:55:30.896889 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7ff4acdc-8caf-4752-b0e0-ff34b8f572f0 req-6b5a9654-c208-4cb7-aa15-1d629dcb3549 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2969267 Nov 12 14:55:30.899914 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-633dd199-8dfa-41c5-bc66-29fa423077f3 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0818520 Nov 12 14:55:30.982874 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d1da11-b668-4812-af83-79832aeb88ec req-dc7725a6-cd55-4f8c-98e7-548922b689e6 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:30.984762 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-73d1da11-b668-4812-af83-79832aeb88ec req-dc7725a6-cd55-4f8c-98e7-548922b689e6 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.0571835 Nov 12 14:55:31.021496 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1838412b-38aa-42de-aeb9-6b85b743f1de req-78521a2b-b122-4c52-96f2-b114ccc117c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:31.023170 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1838412b-38aa-42de-aeb9-6b85b743f1de req-78521a2b-b122-4c52-96f2-b114ccc117c1 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 1097 time: 0.2059839 Nov 12 14:55:31.051079 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-73d1da11-b668-4812-af83-79832aeb88ec req-f9bb9a38-9002-43f5-a65f-628a087d5933 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594141 Nov 12 14:55:31.153078 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-d85384c9-e72a-483b-8328-1ab677feaab6 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2383964 Nov 12 14:55:31.157356 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-261814e2-8aa4-4e3b-8a02-659bced1d6fe req-f0d541f0-ee46-4376-b7dc-9e94cc1f25ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:31.158735 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-261814e2-8aa4-4e3b-8a02-659bced1d6fe req-f0d541f0-ee46-4376-b7dc-9e94cc1f25ed service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3397074 Nov 12 14:55:31.280666 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1838412b-38aa-42de-aeb9-6b85b743f1de req-2b870403-6019-463e-9ab1-067e33ef6a99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:31.282006 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1838412b-38aa-42de-aeb9-6b85b743f1de req-2b870403-6019-463e-9ab1-067e33ef6a99 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&shared=False HTTP/1.1" status: 200 len: 912 time: 0.2392030 Nov 12 14:55:31.328794 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-a1cc1934-d6ff-4631-b822-66910507df05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:31.331243 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-a1cc1934-d6ff-4631-b822-66910507df05 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 1096 time: 0.1238844 Nov 12 14:55:31.345705 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8db8915b-8029-455f-909f-105b5e8b68f3 req-60a06f9e-2464-4a9a-a82c-b94ad6c30265 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1811743 Nov 12 14:55:31.419019 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-91a6690b-b785-4b49-811b-baf71886a55a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=116218b4-72d9-40d7-bcaf-24faa7227810 HTTP/1.1" status: 200 len: 217 time: 0.0722048 Nov 12 14:55:31.448389 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1838412b-38aa-42de-aeb9-6b85b743f1de req-c2f92276-415c-4e20-b85a-bd722ea57d30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:31.449820 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1838412b-38aa-42de-aeb9-6b85b743f1de req-c2f92276-415c-4e20-b85a-bd722ea57d30 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1570389 Nov 12 14:55:31.709623 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 53544) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:31.813850 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7b67ed97-7f61-42b8-bb90-6fd1906451a4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:31.888410 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7b67ed97-7f61-42b8-bb90-6fd1906451a4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:31.895975 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7b67ed97-7f61-42b8-bb90-6fd1906451a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:31.975292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b67ed97-7f61-42b8-bb90-6fd1906451a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=38bf928a-136e-4628-9c04-64b9d18fc99c,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:31.981505 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-7b67ed97-7f61-42b8-bb90-6fd1906451a4 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=9b1d67632ff34eacab8ed2040e91e8ed&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2699835 Nov 12 14:55:31.984754 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53562) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:32.004343 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ea8700-a550-4cbc-be91-b2880e7afab5 req-f4a5533d-1033-4219-9a7c-89cf66272b4a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:32.005871 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-89ea8700-a550-4cbc-be91-b2880e7afab5 req-f4a5533d-1033-4219-9a7c-89cf66272b4a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 944 time: 0.0860038 Nov 12 14:55:32.084079 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-89ea8700-a550-4cbc-be91-b2880e7afab5 req-754a1bbc-9bbb-47e7-b05e-73ce36e33f52 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0713151 Nov 12 14:55:32.120877 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc8dad0-6a11-4bf5-99e0-67b27926abb5 req-8b035505-5a2f-4d92-be5b-bd5d23a91c71 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:32.123718 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cfc8dad0-6a11-4bf5-99e0-67b27926abb5 req-8b035505-5a2f-4d92-be5b-bd5d23a91c71 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 945 time: 0.1335905 Nov 12 14:55:32.125065 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-75ba2f91-8e5a-487d-8577-3caf6e293035 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.171785 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-75ba2f91-8e5a-487d-8577-3caf6e293035 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.213652 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e79c8905-cf1f-4285-b7c3-b5f5ab80a900 req-cd43bc58-af8d-4565-97da-176c6045bffe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:32.215894 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e79c8905-cf1f-4285-b7c3-b5f5ab80a900 req-cd43bc58-af8d-4565-97da-176c6045bffe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.0563607 Nov 12 14:55:32.241249 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cfc8dad0-6a11-4bf5-99e0-67b27926abb5 req-ae44cafb-b230-443b-8e3e-d9d3cc2fb1a2 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025987 Nov 12 14:55:32.268608 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-75ba2f91-8e5a-487d-8577-3caf6e293035 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.272718 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-75ba2f91-8e5a-487d-8577-3caf6e293035 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.275165 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-75ba2f91-8e5a-487d-8577-3caf6e293035 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/38bf928a-136e-4628-9c04-64b9d18fc99c HTTP/1.1" status: 204 len: 168 time: 0.2887430 Nov 12 14:55:32.296251 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75ba2f91-8e5a-487d-8577-3caf6e293035 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=38bf928a-136e-4628-9c04-64b9d18fc99c,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:32.296339 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e79c8905-cf1f-4285-b7c3-b5f5ab80a900 req-32091550-5d20-45a5-842f-045a6aafc74c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697639 Nov 12 14:55:32.556581 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 53592) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:32.569808 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d044f4da-e9e7-434f-9976-99a6c7b8a563 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.647650 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d044f4da-e9e7-434f-9976-99a6c7b8a563 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.651684 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d044f4da-e9e7-434f-9976-99a6c7b8a563 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.691911 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d044f4da-e9e7-434f-9976-99a6c7b8a563 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=239ddd3f5fe1470ea9e35e5a6cb19624&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1320064 Nov 12 14:55:32.691911 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d044f4da-e9e7-434f-9976-99a6c7b8a563 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef965aae-9f69-4538-8fb5-2e09ba7abb85,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:32.693161 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53594) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:32.744457 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-095b7b57-bd06-4e74-a637-cf6cea6cc30e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.764788 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-095b7b57-bd06-4e74-a637-cf6cea6cc30e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.810731 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-095b7b57-bd06-4e74-a637-cf6cea6cc30e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.813034 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-095b7b57-bd06-4e74-a637-cf6cea6cc30e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:32.814180 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-095b7b57-bd06-4e74-a637-cf6cea6cc30e admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/ef965aae-9f69-4538-8fb5-2e09ba7abb85 HTTP/1.1" status: 204 len: 168 time: 0.1199858 Nov 12 14:55:32.821995 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-095b7b57-bd06-4e74-a637-cf6cea6cc30e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef965aae-9f69-4538-8fb5-2e09ba7abb85,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:33.205585 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6145aeaf-dc5d-4d35-ba07-8fdb69ea1978 req-ac1cc652-2f49-494e-addb-d169e7c73426 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:33.207666 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6145aeaf-dc5d-4d35-ba07-8fdb69ea1978 req-ac1cc652-2f49-494e-addb-d169e7c73426 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 944 time: 0.0513566 Nov 12 14:55:33.261693 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6145aeaf-dc5d-4d35-ba07-8fdb69ea1978 req-ccb5e2ed-7a12-4feb-9db2-55fd98417d61 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474458 Nov 12 14:55:33.373132 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc011a39-1413-478d-bf12-1e506daee5ab req-a0cb2eb2-43bb-4dc8-b18f-7120b74a8928 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:33.374614 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dc011a39-1413-478d-bf12-1e506daee5ab req-a0cb2eb2-43bb-4dc8-b18f-7120b74a8928 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 945 time: 0.0548706 Nov 12 14:55:33.431942 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e71211-0e4f-4fcf-8b6a-273f42c46e3e req-752bc004-8a98-4dc5-8e94-e5f91c698fdd tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:33.432401 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dc011a39-1413-478d-bf12-1e506daee5ab req-d747ffbc-badd-4452-a174-6089777e031c tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499320 Nov 12 14:55:33.433466 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d2e71211-0e4f-4fcf-8b6a-273f42c46e3e req-752bc004-8a98-4dc5-8e94-e5f91c698fdd tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.0608935 Nov 12 14:55:33.484975 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d2e71211-0e4f-4fcf-8b6a-273f42c46e3e req-cfae5b69-7f9e-44c3-83b6-c4a058cc78c3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450411 Nov 12 14:55:34.165775 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-1751af48-6d10-4580-b9fd-8d76394b6bbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:34.167246 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-1751af48-6d10-4580-b9fd-8d76394b6bbb service neutron] 10.222.0.86 "GET /v2.0/subnets?id=03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 200 len: 858 time: 0.0796363 Nov 12 14:55:34.174343 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-b5e90167-14a0-4155-bf12-bdec15fccc02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:34.175951 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-b5e90167-14a0-4155-bf12-bdec15fccc02 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 1097 time: 0.0601311 Nov 12 14:55:34.232713 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-215b3350-530e-4e92-b0ce-3bc123faa4af service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0556846 Nov 12 14:55:34.234323 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-2cdebd05-2696-4dc7-af04-ede6c0593a85 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6404f751-2813-4de0-aa94-89a7df49823a HTTP/1.1" status: 200 len: 217 time: 0.0486271 Nov 12 14:55:34.378419 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-186399c3-8395-4522-9cd8-cb1f255fd362 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:34.379875 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-186399c3-8395-4522-9cd8-cb1f255fd362 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 200 len: 850 time: 0.1261041 Nov 12 14:55:34.438734 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-819ac451-4fd3-41ee-9cf6-86265ae69c48 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1927183 Nov 12 14:55:34.455646 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5607f0e6-56d9-4a95-a137-928c7da120f6 req-c928d485-2b50-41aa-b1e9-8b587065d68e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:34.457922 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5607f0e6-56d9-4a95-a137-928c7da120f6 req-c928d485-2b50-41aa-b1e9-8b587065d68e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 944 time: 0.1196196 Nov 12 14:55:34.505176 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-3ac756be-d154-48ab-a13d-b5b7fb759713 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:34.508548 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-3ac756be-d154-48ab-a13d-b5b7fb759713 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1162074 Nov 12 14:55:34.571678 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9adcc1d9-d47a-4ab7-a394-5678e22f8155 req-96e58d54-3382-47d5-bda7-0e7628e4aa33 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:34.573204 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9adcc1d9-d47a-4ab7-a394-5678e22f8155 req-96e58d54-3382-47d5-bda7-0e7628e4aa33 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 945 time: 0.0552545 Nov 12 14:55:34.651780 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5607f0e6-56d9-4a95-a137-928c7da120f6 req-48dc4727-0bf7-4833-bb0e-2dad88359574 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1848869 Nov 12 14:55:34.685449 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a960b5f-3145-4bb2-bd4a-71272b919cdf req-f63d6c5e-f8eb-4e95-9911-8e684c500ec6 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2377594 Nov 12 14:55:34.701341 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9adcc1d9-d47a-4ab7-a394-5678e22f8155 req-588ec7ec-daa7-45db-bb87-fd827c43d900 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1154914 Nov 12 14:55:34.710613 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-7cef444a-ea1c-4de6-a300-49ee8c603b1a service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1681926 Nov 12 14:55:34.848990 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b87e017b-556d-4dc1-bed0-476b3de8ef77 req-76b37d53-5583-427d-90bf-946db3021b13 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:34.850419 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b87e017b-556d-4dc1-bed0-476b3de8ef77 req-76b37d53-5583-427d-90bf-946db3021b13 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.0992744 Nov 12 14:55:34.853972 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f265d39b-bd7c-428c-bf8f-724c8333a362 req-3e527c00-cacc-449b-81dd-2f240f93f0cd service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1311309 Nov 12 14:55:34.902203 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b87e017b-556d-4dc1-bed0-476b3de8ef77 req-5946e0b2-5f26-46ac-945a-559c52dc34ce tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452254 Nov 12 14:55:34.919616 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:35.510388 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1f15370a-838b-414a-9824-824840a9315d up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:35.564555 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 1f15370a-838b-414a-9824-824840a9315d completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:55:35.569450 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 1f15370a-838b-414a-9824-824840a9315d triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:35.569905 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:35.657052 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:35.682177 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '689a1fb3-9828-439c-a3c6-d5c86bbfe89a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f15370a-838b-414a-9824-824840a9315d'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:55:35.876846 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd2adc1-9408-4e4d-a8b4-cc7a1af41b0c req-19345bbb-27de-4278-808f-ff9a1f39f3fa tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:35.878433 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2bd2adc1-9408-4e4d-a8b4-cc7a1af41b0c req-19345bbb-27de-4278-808f-ff9a1f39f3fa tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 944 time: 0.0731354 Nov 12 14:55:35.903174 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 1f15370a-838b-414a-9824-824840a9315d, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1f15370a-838b-414a-9824-824840a9315d,segment=NetworkSegment(596317c1-3ea0-41df-b1b0-0fd9146ab825),segment_id=596317c1-3ea0-41df-b1b0-0fd9146ab825)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:35.921173 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:35.937425 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94634dfb-c660-4978-9ebf-9fcbc4556356 req-25f58734-21b0-4fce-a155-9da15b28be9c tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:35.940682 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-94634dfb-c660-4978-9ebf-9fcbc4556356 req-25f58734-21b0-4fce-a155-9da15b28be9c tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 945 time: 0.1084847 Nov 12 14:55:35.958218 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2bd2adc1-9408-4e4d-a8b4-cc7a1af41b0c req-f6424123-87fa-46a8-aca5-faa26e706fcf tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0735667 Nov 12 14:55:36.002784 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=1f15370a-838b-414a-9824-824840a9315d,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:36.071227 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-94634dfb-c660-4978-9ebf-9fcbc4556356 req-e676f931-302e-48c1-a420-29639e02f08f tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1251497 Nov 12 14:55:36.104941 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-88cfe1fc-9116-40fb-90fb-4c3e844d6086" -d '{"events": [{"server_uuid": "689a1fb3-9828-439c-a3c6-d5c86bbfe89a", "name": "network-vif-plugged", "status": "completed", "tag": "1f15370a-838b-414a-9824-824840a9315d"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:55:36.156048 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fae0d97-f23e-4cbf-b406-e8ccb6d73093 req-da1e7ade-495d-40cf-93b1-2da9ae665eca tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:36.157545 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7fae0d97-f23e-4cbf-b406-e8ccb6d73093 req-da1e7ade-495d-40cf-93b1-2da9ae665eca tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.0803597 Nov 12 14:55:36.208475 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7fae0d97-f23e-4cbf-b406-e8ccb6d73093 req-7e2bdc0e-ae70-42fc-b647-83150e7b9f20 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434301 Nov 12 14:55:36.229324 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:55:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3484ef86-ff4c-4d44-a774-95af8d1cfe71 x-openstack-request-id: req-3484ef86-ff4c-4d44-a774-95af8d1cfe71 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:55:36.229629 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "689a1fb3-9828-439c-a3c6-d5c86bbfe89a", "name": "network-vif-plugged", "status": "completed", "tag": "1f15370a-838b-414a-9824-824840a9315d", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:55:36.229933 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-3484ef86-ff4c-4d44-a774-95af8d1cfe71 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:55:36.230402 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '689a1fb3-9828-439c-a3c6-d5c86bbfe89a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f15370a-838b-414a-9824-824840a9315d', 'code': 200} Nov 12 14:55:37.077169 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f22258ba-cd75-45b6-ae4f-52cc4a784f7a req-b156a4a3-8347-4c9c-a9bb-4081dae54d60 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:37.078665 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f22258ba-cd75-45b6-ae4f-52cc4a784f7a req-b156a4a3-8347-4c9c-a9bb-4081dae54d60 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 944 time: 0.0494270 Nov 12 14:55:37.129083 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f22258ba-cd75-45b6-ae4f-52cc4a784f7a req-798868cc-47dd-4597-9be6-b70d2e56269e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444200 Nov 12 14:55:37.233174 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04673dc0-8fcb-4844-b102-11fb88545621 req-25b9dea9-9b94-4801-bf4b-a10392201b0a tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:37.234761 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-04673dc0-8fcb-4844-b102-11fb88545621 req-25b9dea9-9b94-4801-bf4b-a10392201b0a tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0555036 Nov 12 14:55:37.292249 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-04673dc0-8fcb-4844-b102-11fb88545621 req-f9578536-5d4e-4eb8-af0f-c50cf13dcc8f tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501635 Nov 12 14:55:37.333540 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c437da1-0cf4-474f-92ae-985bdbff909a req-19164a9d-e580-4357-ba21-51011358cf9b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:37.334990 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4c437da1-0cf4-474f-92ae-985bdbff909a req-19164a9d-e580-4357-ba21-51011358cf9b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 943 time: 0.0577013 Nov 12 14:55:37.380989 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4c437da1-0cf4-474f-92ae-985bdbff909a req-7cad445d-43ea-4f4b-ab02-83c977994a38 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400290 Nov 12 14:55:38.021300 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 6404f751-2813-4de0-aa94-89a7df49823a details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:55:38.115693 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 6404f751-2813-4de0-aa94-89a7df49823a, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=6404f751-2813-4de0-aa94-89a7df49823a,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:38.126370 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '6404f751-2813-4de0-aa94-89a7df49823a', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'port_id': '6404f751-2813-4de0-aa94-89a7df49823a', 'mac_address': 'fa:16:3e:ff:97:d6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 642, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:55:38.162853 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:38.175311 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6404f751-2813-4de0-aa94-89a7df49823a {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:55:38.195193 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 6404f751-2813-4de0-aa94-89a7df49823a, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=6404f751-2813-4de0-aa94-89a7df49823a,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:38.199652 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:38.200321 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 116218b4-72d9-40d7-bcaf-24faa7227810 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:55:38.245748 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8dab638-989b-448e-a664-950bcf6bb01b req-7a23802f-de28-4ba7-859c-962c820f9e51 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:38.247344 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a8dab638-989b-448e-a664-950bcf6bb01b req-7a23802f-de28-4ba7-859c-962c820f9e51 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 945 time: 0.0507393 Nov 12 14:55:38.275099 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=6404f751-2813-4de0-aa94-89a7df49823a,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:38.305185 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a8dab638-989b-448e-a664-950bcf6bb01b req-45419dfc-8aad-48c1-9ee1-defff4a7a442 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496449 Nov 12 14:55:38.339615 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 116218b4-72d9-40d7-bcaf-24faa7227810, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=116218b4-72d9-40d7-bcaf-24faa7227810,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:38.351340 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '116218b4-72d9-40d7-bcaf-24faa7227810', 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce', 'port_id': '116218b4-72d9-40d7-bcaf-24faa7227810', 'mac_address': 'fa:16:3e:44:bf:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 619, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '03d9b81e-6504-49f1-9d77-32a1bea3505d', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:55:38.391772 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:38.405771 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 116218b4-72d9-40d7-bcaf-24faa7227810 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:55:38.406515 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7555e629-5553-47b6-aa45-f4a72fefa94d req-8ee5b840-31f3-4fd5-b22e-7813732a5ace tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:38.408742 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7555e629-5553-47b6-aa45-f4a72fefa94d req-8ee5b840-31f3-4fd5-b22e-7813732a5ace tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0488694 Nov 12 14:55:38.428051 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 116218b4-72d9-40d7-bcaf-24faa7227810, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=116218b4-72d9-40d7-bcaf-24faa7227810,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:38.432897 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:38.433222 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device c0d8b239-ac45-4bde-b0fd-049dd324ae18 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:55:38.465519 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7555e629-5553-47b6-aa45-f4a72fefa94d req-4de7fba8-269d-46df-a4fe-ab6cafda3d2d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493290 Nov 12 14:55:38.504275 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07290a69-6148-476f-8c03-69424254b4a0 req-42ebbb26-26fa-4e07-9c55-d0caffae681b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:38.505357 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port c0d8b239-ac45-4bde-b0fd-049dd324ae18, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:38.505729 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07290a69-6148-476f-8c03-69424254b4a0 req-42ebbb26-26fa-4e07-9c55-d0caffae681b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 944 time: 0.0561345 Nov 12 14:55:38.510419 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=116218b4-72d9-40d7-bcaf-24faa7227810,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:38.521591 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'c0d8b239-ac45-4bde-b0fd-049dd324ae18', 'network_id': '6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce', 'port_id': 'c0d8b239-ac45-4bde-b0fd-049dd324ae18', 'mac_address': 'fa:16:3e:a8:f6:d4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 619, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '03d9b81e-6504-49f1-9d77-32a1bea3505d', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:55:38.553535 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07290a69-6148-476f-8c03-69424254b4a0 req-0c503038-5978-4913-abc2-b946e95c40de tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418417 Nov 12 14:55:38.559212 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:38.573253 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c0d8b239-ac45-4bde-b0fd-049dd324ae18 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:55:38.593263 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port c0d8b239-ac45-4bde-b0fd-049dd324ae18, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:38.597535 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:38.652823 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=c0d8b239-ac45-4bde-b0fd-049dd324ae18,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:39.287953 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e203bb07-7570-4db6-bd71-a3d422cf80c2 req-41a7eb60-5ae6-48f9-b388-00c181e5702f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:39.289453 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e203bb07-7570-4db6-bd71-a3d422cf80c2 req-41a7eb60-5ae6-48f9-b388-00c181e5702f service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 1099 time: 0.0679166 Nov 12 14:55:39.317636 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e203bb07-7570-4db6-bd71-a3d422cf80c2 req-76250e57-e046-481e-9b80-a96fafd0f3e3 service neutron] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:39.424136 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e203bb07-7570-4db6-bd71-a3d422cf80c2 req-76250e57-e046-481e-9b80-a96fafd0f3e3 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:39.432743 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e203bb07-7570-4db6-bd71-a3d422cf80c2 req-76250e57-e046-481e-9b80-a96fafd0f3e3 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:39.443330 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e172f5f2-7488-42f1-b391-b1086fa58388 req-938d813b-e6c1-47ed-868e-5905e3fa5b1a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:39.445159 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e172f5f2-7488-42f1-b391-b1086fa58388 req-938d813b-e6c1-47ed-868e-5905e3fa5b1a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 945 time: 0.0560098 Nov 12 14:55:39.456719 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['116218b4-72d9-40d7-bcaf-24faa7227810'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:55:39.500747 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e203bb07-7570-4db6-bd71-a3d422cf80c2 req-76250e57-e046-481e-9b80-a96fafd0f3e3 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1986172 Nov 12 14:55:39.511375 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e172f5f2-7488-42f1-b391-b1086fa58388 req-e1d6d927-04f6-460f-8296-600d0b132ad0 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0574136 Nov 12 14:55:39.517833 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['6404f751-2813-4de0-aa94-89a7df49823a'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:55:39.520199 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76250e57-e046-481e-9b80-a96fafd0f3e3 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=4b2dc96f-8ece-4ffc-9d4e-3825cf81f90b,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:39.557277 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['c0d8b239-ac45-4bde-b0fd-049dd324ae18'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:55:39.621082 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6bb216-56c4-4b55-a37c-38d41e06069e req-d783ed38-a6e9-4365-8fd0-6dd1c5bd9d9d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:39.629161 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9d6bb216-56c4-4b55-a37c-38d41e06069e req-d783ed38-a6e9-4365-8fd0-6dd1c5bd9d9d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0653927 Nov 12 14:55:39.700664 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff17c452-49eb-493d-ac95-1c65bedb5124 req-36013449-bbe2-4b94-8e3c-8c5da48d3cdf tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:39.702479 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ff17c452-49eb-493d-ac95-1c65bedb5124 req-36013449-bbe2-4b94-8e3c-8c5da48d3cdf tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 944 time: 0.0742180 Nov 12 14:55:39.716435 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9d6bb216-56c4-4b55-a37c-38d41e06069e req-29eaebf3-86dc-4a27-a633-0d638febe97a tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860126 Nov 12 14:55:39.774076 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ff17c452-49eb-493d-ac95-1c65bedb5124 req-1f2916dc-f356-461a-99db-1af9dcdb01c1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652518 Nov 12 14:55:40.055845 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 53844) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:40.203687 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-32cb6ce1-cbea-41e9-9309-0ac9324d36dc admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.283963 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-32cb6ce1-cbea-41e9-9309-0ac9324d36dc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.288051 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 53856) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:40.293743 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-32cb6ce1-cbea-41e9-9309-0ac9324d36dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.335506 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-32cb6ce1-cbea-41e9-9309-0ac9324d36dc admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=379673eade8f45478857527996fab27e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2775459 Nov 12 14:55:40.336374 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32cb6ce1-cbea-41e9-9309-0ac9324d36dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ad134ae2-3e5e-48a8-96a4-3fd411eac2eb,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:40.339218 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53860) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:40.397568 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-049a6ac5-a829-44e2-bce1-5491395b662b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.413219 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0c4e3c49-cef6-4867-ae4a-7a63fd5f0cd7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.430935 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-049a6ac5-a829-44e2-bce1-5491395b662b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.495174 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-049a6ac5-a829-44e2-bce1-5491395b662b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.508612 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-049a6ac5-a829-44e2-bce1-5491395b662b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.509779 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-049a6ac5-a829-44e2-bce1-5491395b662b admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/ad134ae2-3e5e-48a8-96a4-3fd411eac2eb HTTP/1.1" status: 204 len: 168 time: 0.1691515 Nov 12 14:55:40.518618 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-049a6ac5-a829-44e2-bce1-5491395b662b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ad134ae2-3e5e-48a8-96a4-3fd411eac2eb,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:40.714710 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0c4e3c49-cef6-4867-ae4a-7a63fd5f0cd7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.728596 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0c4e3c49-cef6-4867-ae4a-7a63fd5f0cd7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.748020 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a31a41-8d08-4b71-8564-8d6ece3a8591 req-306652d5-1443-4983-b508-134f3c564900 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:40.749701 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a8a31a41-8d08-4b71-8564-8d6ece3a8591 req-306652d5-1443-4983-b508-134f3c564900 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 945 time: 0.1069465 Nov 12 14:55:40.803315 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c4e3c49-cef6-4867-ae4a-7a63fd5f0cd7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1a273ff-dfc1-4d49-9781-152f3c08b9e6,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:40.809771 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-0c4e3c49-cef6-4867-ae4a-7a63fd5f0cd7 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=1eebc5d8f5bd4cc192d2f959442c5a69&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5182247 Nov 12 14:55:40.810479 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53894) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:40.872772 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a8a31a41-8d08-4b71-8564-8d6ece3a8591 req-81c77959-e10c-448e-901c-08a6c26ea249 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1091542 Nov 12 14:55:40.940256 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f85ccde6-12a8-4eac-a1f1-19f745a73939 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:40.962233 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ca8c350-7089-427b-abc3-7a62464eabd0 req-040f7583-7e9a-4460-a5ed-5b68460aca27 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:40.964222 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0ca8c350-7089-427b-abc3-7a62464eabd0 req-040f7583-7e9a-4460-a5ed-5b68460aca27 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0924683 Nov 12 14:55:41.005986 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f85ccde6-12a8-4eac-a1f1-19f745a73939 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.008972 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa76c935-9ba8-49bd-98bc-e7236094db65 req-2feefad6-3c54-4262-9670-78e528de1d4c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:41.010283 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa76c935-9ba8-49bd-98bc-e7236094db65 req-2feefad6-3c54-4262-9670-78e528de1d4c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 944 time: 0.0660598 Nov 12 14:55:41.068884 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0ca8c350-7089-427b-abc3-7a62464eabd0 req-9ef79d31-45f9-4bfd-b36b-d8493159e8fd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967846 Nov 12 14:55:41.088725 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa76c935-9ba8-49bd-98bc-e7236094db65 req-57aa08af-24a7-4701-b0b4-0b4fd6a10923 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695775 Nov 12 14:55:41.094113 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f85ccde6-12a8-4eac-a1f1-19f745a73939 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.097475 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f85ccde6-12a8-4eac-a1f1-19f745a73939 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.098909 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f85ccde6-12a8-4eac-a1f1-19f745a73939 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/c1a273ff-dfc1-4d49-9781-152f3c08b9e6 HTTP/1.1" status: 204 len: 168 time: 0.2867930 Nov 12 14:55:41.115563 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85ccde6-12a8-4eac-a1f1-19f745a73939 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1a273ff-dfc1-4d49-9781-152f3c08b9e6,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:41.473247 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53930) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:41.489710 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-bac447ab-ab85-4db2-b046-0c63779dd2db admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.519732 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 6404f751-2813-4de0-aa94-89a7df49823a up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:41.575114 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 53932) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:41.587336 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 6404f751-2813-4de0-aa94-89a7df49823a completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:55:41.596418 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 6404f751-2813-4de0-aa94-89a7df49823a triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:41.597223 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.640859 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-bac447ab-ab85-4db2-b046-0c63779dd2db admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.646873 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-bac447ab-ab85-4db2-b046-0c63779dd2db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.701563 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bac447ab-ab85-4db2-b046-0c63779dd2db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86017213-1714-4396-a8a6-1eed1d15e775,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:41.711321 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-bac447ab-ab85-4db2-b046-0c63779dd2db admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=6c0310429bb8470eb6f157e5069d1fa3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2352359 Nov 12 14:55:41.715594 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 53940) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:41.719973 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.751141 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6404f751-2813-4de0-aa94-89a7df49823a'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:55:41.754244 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-26eeae2c-ab8c-4a95-bab8-439ca05e04a6" -d '{"events": [{"server_uuid": "750b2499-ec22-4102-9133-f6a0fdb713d0", "name": "network-vif-plugged", "status": "completed", "tag": "6404f751-2813-4de0-aa94-89a7df49823a"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:55:41.759361 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c15086d-35c0-44e9-b241-a39a66917996 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.770199 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 6404f751-2813-4de0-aa94-89a7df49823a, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=6404f751-2813-4de0-aa94-89a7df49823a,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:41.780267 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.780267 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 116218b4-72d9-40d7-bcaf-24faa7227810 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:41.806914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-00c6752e-7166-4386-b66d-03672d7b4370 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.827555 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:55:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d6f4250-d66d-4aab-aee3-65e3135989d9 x-openstack-request-id: req-5d6f4250-d66d-4aab-aee3-65e3135989d9 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:55:41.827871 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "750b2499-ec22-4102-9133-f6a0fdb713d0", "name": "network-vif-plugged", "status": "completed", "tag": "6404f751-2813-4de0-aa94-89a7df49823a", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:55:41.828336 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-5d6f4250-d66d-4aab-aee3-65e3135989d9 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:55:41.828990 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6404f751-2813-4de0-aa94-89a7df49823a', 'code': 200} Nov 12 14:55:41.849107 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-00c6752e-7166-4386-b66d-03672d7b4370 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.880516 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=6404f751-2813-4de0-aa94-89a7df49823a,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:41.896997 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 116218b4-72d9-40d7-bcaf-24faa7227810 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:55:41.910661 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 116218b4-72d9-40d7-bcaf-24faa7227810 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:41.911573 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.929533 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c15086d-35c0-44e9-b241-a39a66917996 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.935086 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c15086d-35c0-44e9-b241-a39a66917996 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.953884 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-00c6752e-7166-4386-b66d-03672d7b4370 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.957163 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-00c6752e-7166-4386-b66d-03672d7b4370 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:41.958321 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-00c6752e-7166-4386-b66d-03672d7b4370 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/86017213-1714-4396-a8a6-1eed1d15e775 HTTP/1.1" status: 204 len: 168 time: 0.2412167 Nov 12 14:55:41.998837 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53956) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:41.998968 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-3c15086d-35c0-44e9-b241-a39a66917996 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=6d40542331684a17a0a2632a2b8d653f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4223557 Nov 12 14:55:42.000049 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c15086d-35c0-44e9-b241-a39a66917996 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fccb7cfb-77d6-4c6c-b4f1-fbce01e6ca55,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:42.023950 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c6752e-7166-4386-b66d-03672d7b4370 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86017213-1714-4396-a8a6-1eed1d15e775,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:42.047245 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.117814 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-529c366d-7362-4a49-92f8-6656a9417bdc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.139410 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ea61ee-584e-4d7c-bd58-19e7ed8995e0 req-13e3b3c5-ff2d-4115-b2cf-3adcb34568b1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:42.141027 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 116218b4-72d9-40d7-bcaf-24faa7227810, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=116218b4-72d9-40d7-bcaf-24faa7227810,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:42.143969 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-48ea61ee-584e-4d7c-bd58-19e7ed8995e0 req-13e3b3c5-ff2d-4115-b2cf-3adcb34568b1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1143718 Nov 12 14:55:42.159843 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.161687 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device c0d8b239-ac45-4bde-b0fd-049dd324ae18 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:55:42.201111 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-529c366d-7362-4a49-92f8-6656a9417bdc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.274806 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-48ea61ee-584e-4d7c-bd58-19e7ed8995e0 req-37a6362c-4843-4da1-a120-bf709f89c34f tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1234803 Nov 12 14:55:42.326306 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-529c366d-7362-4a49-92f8-6656a9417bdc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.329067 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-529c366d-7362-4a49-92f8-6656a9417bdc admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.330261 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-529c366d-7362-4a49-92f8-6656a9417bdc admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/fccb7cfb-77d6-4c6c-b4f1-fbce01e6ca55 HTTP/1.1" status: 204 len: 168 time: 0.3303699 Nov 12 14:55:42.385436 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-529c366d-7362-4a49-92f8-6656a9417bdc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fccb7cfb-77d6-4c6c-b4f1-fbce01e6ca55,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:42.400707 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=116218b4-72d9-40d7-bcaf-24faa7227810,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:42.448038 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd2d13c-666f-4e0a-a1b9-2143e732477a req-faad4d2a-e785-4b83-b901-f1f07a0df1c8 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:42.464735 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4dd2d13c-666f-4e0a-a1b9-2143e732477a req-faad4d2a-e785-4b83-b901-f1f07a0df1c8 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.1645603 Nov 12 14:55:42.483866 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port c0d8b239-ac45-4bde-b0fd-049dd324ae18 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:55:42.512593 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port c0d8b239-ac45-4bde-b0fd-049dd324ae18 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:55:42.513343 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.531277 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef1e1fe1-4087-42d6-bc81-e2f0d42d9bd9 req-53acbc0e-0146-4b87-bee5-2b79b87ff635 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:42.539318 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ef1e1fe1-4087-42d6-bc81-e2f0d42d9bd9 req-53acbc0e-0146-4b87-bee5-2b79b87ff635 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1435828 Nov 12 14:55:42.594829 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4dd2d13c-666f-4e0a-a1b9-2143e732477a req-e5c1a09d-da59-45a5-aed1-5b7fe11f3c92 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1228428 Nov 12 14:55:42.644150 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ef1e1fe1-4087-42d6-bc81-e2f0d42d9bd9 req-30a50376-978f-4733-8f2f-bc235716abd8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0997205 Nov 12 14:55:42.735272 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.786909 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port c0d8b239-ac45-4bde-b0fd-049dd324ae18, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:55:42.793485 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.863646 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=c0d8b239-ac45-4bde-b0fd-049dd324ae18,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:42.887446 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 53996) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:42.904668 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e48e5bce-1aac-4dd3-a1b1-e41f96aab7e1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:42.998749 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e48e5bce-1aac-4dd3-a1b1-e41f96aab7e1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:43.003081 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e48e5bce-1aac-4dd3-a1b1-e41f96aab7e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:43.050779 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e48e5bce-1aac-4dd3-a1b1-e41f96aab7e1 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=84b0a46f69e346f19f064fac431b29b0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1614988 Nov 12 14:55:43.053375 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54006) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:43.068802 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e48e5bce-1aac-4dd3-a1b1-e41f96aab7e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a5d5fde-d8c7-42ea-9ef0-656a09d59ff8,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:43.107887 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f7b429a-065b-4b1c-a0ba-4d9e09cec221 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:43.130694 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f7b429a-065b-4b1c-a0ba-4d9e09cec221 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:43.191777 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f7b429a-065b-4b1c-a0ba-4d9e09cec221 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:43.194938 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f7b429a-065b-4b1c-a0ba-4d9e09cec221 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:43.199453 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-7f7b429a-065b-4b1c-a0ba-4d9e09cec221 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/8a5d5fde-d8c7-42ea-9ef0-656a09d59ff8 HTTP/1.1" status: 204 len: 168 time: 0.1450357 Nov 12 14:55:43.207410 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f7b429a-065b-4b1c-a0ba-4d9e09cec221 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a5d5fde-d8c7-42ea-9ef0-656a09d59ff8,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:43.377739 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d5bc82b-bd37-49c9-bc9f-0ba4da3f32d1 req-3a4c2f4c-87c3-42a9-842d-cc753ca5c581 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:43.379415 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0d5bc82b-bd37-49c9-bc9f-0ba4da3f32d1 req-3a4c2f4c-87c3-42a9-842d-cc753ca5c581 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0532990 Nov 12 14:55:43.432644 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0d5bc82b-bd37-49c9-bc9f-0ba4da3f32d1 req-d80f715f-e120-4979-94a0-156bc9fa7f69 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452299 Nov 12 14:55:43.695568 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54042) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:43.709534 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6279e1dd-bb18-4e15-b7d6-265c5412a1fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:43.776672 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aed9a03-fb3d-4054-ba5c-5c3ae635ef0d req-5926964b-4c2d-4fea-9f04-dd78454834ba tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:43.784894 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9aed9a03-fb3d-4054-ba5c-5c3ae635ef0d req-5926964b-4c2d-4fea-9f04-dd78454834ba tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0627937 Nov 12 14:55:43.830886 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '79a36c2e-a840-40bd-aaf3-6b40146ff2c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '116218b4-72d9-40d7-bcaf-24faa7227810'}, {'server_uuid': '50446844-a322-466f-b059-0a36b7993f9e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0d8b239-ac45-4bde-b0fd-049dd324ae18'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:55:43.833785 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-103cdbb4-2a58-428b-8e3e-3761b51e225c" -d '{"events": [{"server_uuid": "79a36c2e-a840-40bd-aaf3-6b40146ff2c5", "name": "network-vif-plugged", "status": "completed", "tag": "116218b4-72d9-40d7-bcaf-24faa7227810"}, {"server_uuid": "50446844-a322-466f-b059-0a36b7993f9e", "name": "network-vif-plugged", "status": "completed", "tag": "c0d8b239-ac45-4bde-b0fd-049dd324ae18"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:55:43.857385 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9aed9a03-fb3d-4054-ba5c-5c3ae635ef0d req-77f6ba78-db09-4ea0-afba-c1febbf93ffc tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715470 Nov 12 14:55:43.860184 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6279e1dd-bb18-4e15-b7d6-265c5412a1fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:43.867118 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6279e1dd-bb18-4e15-b7d6-265c5412a1fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:43.907092 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Fri, 12 Nov 2021 14:55:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-740d4e09-26ff-4a50-b4b8-7c2ae0edd28c x-openstack-request-id: req-740d4e09-26ff-4a50-b4b8-7c2ae0edd28c {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:55:43.907644 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "79a36c2e-a840-40bd-aaf3-6b40146ff2c5", "name": "network-vif-plugged", "status": "completed", "tag": "116218b4-72d9-40d7-bcaf-24faa7227810", "code": 200}, {"server_uuid": "50446844-a322-466f-b059-0a36b7993f9e", "name": "network-vif-plugged", "status": "completed", "tag": "c0d8b239-ac45-4bde-b0fd-049dd324ae18", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:55:43.908851 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-740d4e09-26ff-4a50-b4b8-7c2ae0edd28c {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:55:43.909463 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '79a36c2e-a840-40bd-aaf3-6b40146ff2c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '116218b4-72d9-40d7-bcaf-24faa7227810', 'code': 200} Nov 12 14:55:43.909904 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50446844-a322-466f-b059-0a36b7993f9e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c0d8b239-ac45-4bde-b0fd-049dd324ae18', 'code': 200} Nov 12 14:55:43.917330 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54050) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:43.917515 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6279e1dd-bb18-4e15-b7d6-265c5412a1fa admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=719473522c954134be1d536b5c0033e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2208736 Nov 12 14:55:43.918740 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6279e1dd-bb18-4e15-b7d6-265c5412a1fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a88062a7-03e3-4695-a480-541566ddffd5,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:43.990016 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0b3d4235-fa0f-42b9-8318-e34ec06f8807 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:44.017346 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0b3d4235-fa0f-42b9-8318-e34ec06f8807 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:44.066991 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0b3d4235-fa0f-42b9-8318-e34ec06f8807 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:44.069554 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0b3d4235-fa0f-42b9-8318-e34ec06f8807 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:44.070680 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-0b3d4235-fa0f-42b9-8318-e34ec06f8807 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/a88062a7-03e3-4695-a480-541566ddffd5 HTTP/1.1" status: 204 len: 168 time: 0.1514790 Nov 12 14:55:44.081560 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b3d4235-fa0f-42b9-8318-e34ec06f8807 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a88062a7-03e3-4695-a480-541566ddffd5,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:44.639214 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b8d8fec-2f47-461c-b638-115581c083c3 req-64c46fe7-90ad-478e-b21d-83163c603722 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:44.641350 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b8d8fec-2f47-461c-b638-115581c083c3 req-64c46fe7-90ad-478e-b21d-83163c603722 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1053228 Nov 12 14:55:44.725877 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b8d8fec-2f47-461c-b638-115581c083c3 req-275106b2-73b3-4072-bff5-5f6a8559755e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0775189 Nov 12 14:55:44.862467 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17388bfe-5586-4c04-a0c9-d5836465f041 req-4f56e7e6-f89b-4b5b-abfa-6734de2bc96d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:44.863998 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-17388bfe-5586-4c04-a0c9-d5836465f041 req-4f56e7e6-f89b-4b5b-abfa-6734de2bc96d service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 1099 time: 0.1077724 Nov 12 14:55:44.872362 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a884737b-0735-43c4-a11f-6b3086497936 req-e4c10c9d-503c-4e2c-8ee8-69a59c4b781b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:44.874189 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a884737b-0735-43c4-a11f-6b3086497936 req-e4c10c9d-503c-4e2c-8ee8-69a59c4b781b service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1098 time: 0.1402261 Nov 12 14:55:44.892213 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bad1bb-b68d-48e5-8452-63f8083a7138 req-3a6efa3e-8289-4a3f-a035-91fc68ef71c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:44.894388 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-71bad1bb-b68d-48e5-8452-63f8083a7138 req-3a6efa3e-8289-4a3f-a035-91fc68ef71c6 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 1098 time: 0.1050696 Nov 12 14:55:44.977376 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-17388bfe-5586-4c04-a0c9-d5836465f041 req-58fbf5d1-118e-4dc8-884a-7101da257fa5 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1019511 Nov 12 14:55:44.995801 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a884737b-0735-43c4-a11f-6b3086497936 req-71e956c3-69a3-4d19-b2c4-f350f17c81dd service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114109 Nov 12 14:55:44.998272 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-71bad1bb-b68d-48e5-8452-63f8083a7138 req-343a9737-c1b5-43b6-8fbb-17b7e6669225 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888453 Nov 12 14:55:45.029956 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605002fe-33cb-45e7-86c1-1a5b01089720 req-97a8fc6f-4111-4a01-bb77-523c7f183b3a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:45.029956 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-605002fe-33cb-45e7-86c1-1a5b01089720 req-97a8fc6f-4111-4a01-bb77-523c7f183b3a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0725558 Nov 12 14:55:45.090245 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-605002fe-33cb-45e7-86c1-1a5b01089720 req-bb36377f-d624-4cf5-8991-0fd5f1494787 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543861 Nov 12 14:55:45.873081 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73c07e3-af3f-4868-8a81-057286dcfbe2 req-934121c4-6715-41bd-af4f-09c72b5ec30f tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:45.874809 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a73c07e3-af3f-4868-8a81-057286dcfbe2 req-934121c4-6715-41bd-af4f-09c72b5ec30f tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0622332 Nov 12 14:55:45.941176 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a73c07e3-af3f-4868-8a81-057286dcfbe2 req-3c18c014-ffee-4068-94b3-8afa3514f08b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594044 Nov 12 14:55:46.223865 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717a0631-ec75-4adf-babe-dbf9c6fda6ce req-f41080d9-ecce-4b08-a670-f4f9ea55eab2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:46.225230 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-717a0631-ec75-4adf-babe-dbf9c6fda6ce req-f41080d9-ecce-4b08-a670-f4f9ea55eab2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0571368 Nov 12 14:55:46.276705 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-717a0631-ec75-4adf-babe-dbf9c6fda6ce req-85a68b84-bd49-4bd2-9a2c-a9c701a51041 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453889 Nov 12 14:55:46.428670 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54208) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:46.556978 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-91eaa6f4-c539-46c4-bd3d-257efbbcb9ed admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:46.649979 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-91eaa6f4-c539-46c4-bd3d-257efbbcb9ed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:46.657493 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-91eaa6f4-c539-46c4-bd3d-257efbbcb9ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:46.703938 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-91eaa6f4-c539-46c4-bd3d-257efbbcb9ed admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=5abf3cb7b4cf49be9d9dfca4f635ad37&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2741823 Nov 12 14:55:46.706222 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91eaa6f4-c539-46c4-bd3d-257efbbcb9ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f9f1306b-2d42-4749-a673-9ed257bc7404,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:46.706765 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54222) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:46.759269 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e4b90fcc-359d-4865-9d59-cf2b57d4ef31 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:46.782639 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e4b90fcc-359d-4865-9d59-cf2b57d4ef31 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:46.829190 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e4b90fcc-359d-4865-9d59-cf2b57d4ef31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:46.832307 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e4b90fcc-359d-4865-9d59-cf2b57d4ef31 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:46.833427 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e4b90fcc-359d-4865-9d59-cf2b57d4ef31 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f9f1306b-2d42-4749-a673-9ed257bc7404 HTTP/1.1" status: 204 len: 168 time: 0.1254768 Nov 12 14:55:46.841222 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b90fcc-359d-4865-9d59-cf2b57d4ef31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f9f1306b-2d42-4749-a673-9ed257bc7404,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:47.071043 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb80d550-6f46-4830-b586-84442d47d1cb req-2030594a-959e-458b-80ec-0b9a52c7cd33 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:47.072708 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fb80d550-6f46-4830-b586-84442d47d1cb req-2030594a-959e-458b-80ec-0b9a52c7cd33 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0510230 Nov 12 14:55:47.127179 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fb80d550-6f46-4830-b586-84442d47d1cb req-d0b13731-7cee-4c7d-8db2-f6cbefad3f32 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451086 Nov 12 14:55:47.193395 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54246) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:47.207167 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0ad91763-6ad0-436e-a6ab-2eb59e168b18 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:47.286293 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0ad91763-6ad0-436e-a6ab-2eb59e168b18 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:47.290632 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0ad91763-6ad0-436e-a6ab-2eb59e168b18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:47.329179 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-0ad91763-6ad0-436e-a6ab-2eb59e168b18 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=8bd9ea1fd69e457d8ed00b18849dc0c6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1346962 Nov 12 14:55:47.330162 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ad91763-6ad0-436e-a6ab-2eb59e168b18 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8fb89b41-8552-4bae-b410-8b9853621e6c,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:47.331798 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54250) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:47.382072 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0c6f4001-fd2d-49d4-bc95-e0322e5e26e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:47.399223 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3c0338-3937-4cb8-a7e3-f64392cc7551 req-0c51a292-ee67-486d-85ba-8fd1af2250c8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:47.400782 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fc3c0338-3937-4cb8-a7e3-f64392cc7551 req-0c51a292-ee67-486d-85ba-8fd1af2250c8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0504231 Nov 12 14:55:47.406785 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0c6f4001-fd2d-49d4-bc95-e0322e5e26e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:47.448882 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fc3c0338-3937-4cb8-a7e3-f64392cc7551 req-b80528c6-ac4d-4a89-bd82-26c16328117e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419459 Nov 12 14:55:47.454192 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0c6f4001-fd2d-49d4-bc95-e0322e5e26e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:47.456973 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0c6f4001-fd2d-49d4-bc95-e0322e5e26e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:47.458116 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-0c6f4001-fd2d-49d4-bc95-e0322e5e26e2 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/8fb89b41-8552-4bae-b410-8b9853621e6c HTTP/1.1" status: 204 len: 168 time: 0.1239328 Nov 12 14:55:47.466371 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c6f4001-fd2d-49d4-bc95-e0322e5e26e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fb89b41-8552-4bae-b410-8b9853621e6c,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:48.260683 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4859f80f-4d8a-4052-8f06-ad4bbe654847 req-33ed680f-a735-4801-b930-eb470f56cee6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:48.262373 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4859f80f-4d8a-4052-8f06-ad4bbe654847 req-33ed680f-a735-4801-b930-eb470f56cee6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0522125 Nov 12 14:55:48.313621 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4859f80f-4d8a-4052-8f06-ad4bbe654847 req-ed8df2a5-6fb5-440b-ba1e-b0f96d6b605b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452864 Nov 12 14:55:48.510375 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54296) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:48.580308 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e9ec11-2cc1-483c-b9bd-1f07cd85d608 req-46c51616-bd70-40a1-8015-866da5eb160c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:48.581854 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b1e9ec11-2cc1-483c-b9bd-1f07cd85d608 req-46c51616-bd70-40a1-8015-866da5eb160c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0534296 Nov 12 14:55:48.620979 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1b16b2dd-39bb-424f-ac6c-35081d3a8bf1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:48.633010 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b1e9ec11-2cc1-483c-b9bd-1f07cd85d608 req-dc58de6b-d3a1-469b-9eb7-5f74ea66a1a4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452008 Nov 12 14:55:48.696196 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1b16b2dd-39bb-424f-ac6c-35081d3a8bf1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:48.700310 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1b16b2dd-39bb-424f-ac6c-35081d3a8bf1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:48.740722 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-1b16b2dd-39bb-424f-ac6c-35081d3a8bf1 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=30d2741be5714c92ad3c51b912b67ca6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2292891 Nov 12 14:55:48.741831 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b16b2dd-39bb-424f-ac6c-35081d3a8bf1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83997747-a77b-4f48-91aa-9987120eb412,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:48.743409 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54300) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:48.796336 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1689a03e-a86d-4e34-bf7c-80366601ad6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:48.818199 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1689a03e-a86d-4e34-bf7c-80366601ad6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:48.863866 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1689a03e-a86d-4e34-bf7c-80366601ad6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:48.866478 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1689a03e-a86d-4e34-bf7c-80366601ad6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:48.867705 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-1689a03e-a86d-4e34-bf7c-80366601ad6f admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/83997747-a77b-4f48-91aa-9987120eb412 HTTP/1.1" status: 204 len: 168 time: 0.1231804 Nov 12 14:55:48.875672 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1689a03e-a86d-4e34-bf7c-80366601ad6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83997747-a77b-4f48-91aa-9987120eb412,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:49.429173 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef584e32-5b81-44bf-95d6-a4e85472cfc9 req-b2badd9d-71c6-4464-bf6e-2f1a23f68a30 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:49.430708 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ef584e32-5b81-44bf-95d6-a4e85472cfc9 req-b2badd9d-71c6-4464-bf6e-2f1a23f68a30 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0487678 Nov 12 14:55:49.477873 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ef584e32-5b81-44bf-95d6-a4e85472cfc9 req-f3e475f2-0c30-4fa5-b192-68d25c1b7264 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411782 Nov 12 14:55:49.596576 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1022ce8-d844-42c7-ae77-f29d03c44f6f req-9307f389-15ae-44f6-9112-ae567b135028 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:49.598374 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b1022ce8-d844-42c7-ae77-f29d03c44f6f req-9307f389-15ae-44f6-9112-ae567b135028 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0561750 Nov 12 14:55:49.607092 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54320) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:49.612712 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-6d3987ed-591a-4fa1-8455-b6e79f6dbc57 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'floatingip': {'port_id': '6404f751-2813-4de0-aa94-89a7df49823a'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:55:49.685720 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6d3987ed-591a-4fa1-8455-b6e79f6dbc57 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:49.764156 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55762665-b920-4d98-844f-792256e65b38 req-75004494-360d-4713-bd8d-5c0ead9c7211 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:49.765688 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-55762665-b920-4d98-844f-792256e65b38 req-75004494-360d-4713-bd8d-5c0ead9c7211 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0494530 Nov 12 14:55:49.817833 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-55762665-b920-4d98-844f-792256e65b38 req-b95dfd90-ad51-4fa2-90db-51d47a23ab19 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452542 Nov 12 14:55:50.358684 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6d3987ed-591a-4fa1-8455-b6e79f6dbc57 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:50.362866 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6d3987ed-591a-4fa1-8455-b6e79f6dbc57 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:50.463406 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [None req-6d3987ed-591a-4fa1-8455-b6e79f6dbc57 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Floating IP 48ff26c1-7f96-4175-96c9-7a0a9c6a28ba associated. External IP: 172.27.3.9, port: 6404f751-2813-4de0-aa94-89a7df49823a. Nov 12 14:55:50.873566 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d3987ed-591a-4fa1-8455-b6e79f6dbc57 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Router a08d9f45-c652-4276-867c-ab77c8f81aef has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 14:55:50.983685 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-700fa30d-b30d-4a74-a11c-624f732b8441 req-ba83ddef-af21-472f-a7a9-447229014787 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:50.985368 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-700fa30d-b30d-4a74-a11c-624f732b8441 req-ba83ddef-af21-472f-a7a9-447229014787 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0965865 Nov 12 14:55:51.063334 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d3987ed-591a-4fa1-8455-b6e79f6dbc57 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:55:51.071145 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6d3987ed-591a-4fa1-8455-b6e79f6dbc57 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:51.077505 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] Sync routers for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:55:51.088477 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:55:51.089250 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:55:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:51.096140 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-700fa30d-b30d-4a74-a11c-624f732b8441 req-dae8e343-88f7-4f1f-a79a-0f5d4458243e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787351 Nov 12 14:55:51.112558 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-6d3987ed-591a-4fa1-8455-b6e79f6dbc57 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "PUT /v2.0/floatingips/48ff26c1-7f96-4175-96c9-7a0a9c6a28ba HTTP/1.1" status: 200 len: 990 time: 1.5042074 Nov 12 14:55:51.113191 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'tag': '6404f751-2813-4de0-aa94-89a7df49823a'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:55:51.124625 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-689a8782-4de6-4d84-8ee5-a32e002f79e4" -d '{"events": [{"name": "network-changed", "server_uuid": "750b2499-ec22-4102-9133-f6a0fdb713d0", "tag": "6404f751-2813-4de0-aa94-89a7df49823a"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:55:51.183902 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:55:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f057239-d332-47ef-8408-073b97f9f3a9 x-openstack-request-id: req-0f057239-d332-47ef-8408-073b97f9f3a9 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:55:51.184212 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "750b2499-ec22-4102-9133-f6a0fdb713d0", "tag": "6404f751-2813-4de0-aa94-89a7df49823a", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:55:51.184502 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-0f057239-d332-47ef-8408-073b97f9f3a9 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:55:51.184945 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'tag': '6404f751-2813-4de0-aa94-89a7df49823a', 'status': 'completed', 'code': 200} Nov 12 14:55:51.209991 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:55:51.468271 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9eb84b8-2350-4729-a62d-34d1446da846 req-eae49bd6-08fd-4116-8933-f0345e417ca8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:51.472471 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f9eb84b8-2350-4729-a62d-34d1446da846 req-eae49bd6-08fd-4116-8933-f0345e417ca8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0608053 Nov 12 14:55:51.519132 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '48ff26c1-7f96-4175-96c9-7a0a9c6a28ba', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'floating_ip_address': '172.27.3.9', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'port_id': '6404f751-2813-4de0-aa94-89a7df49823a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 121, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'mac_address': 'fa:16:3e:ff:97:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T14:55:11Z', 'updated_at': '2021-11-12T14:55:50Z', 'revision_number': 1, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:51.522100 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f9eb84b8-2350-4729-a62d-34d1446da846 req-52f3b065-e5a3-4477-b091-3496d253670a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460620 Nov 12 14:55:51.546202 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] Checking router: a08d9f45-c652-4276-867c-ab77c8f81aef for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:55:51.554930 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:55:51.555660 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:55:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:51.748745 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:55:51.967546 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '48ff26c1-7f96-4175-96c9-7a0a9c6a28ba', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'floating_ip_address': '172.27.3.9', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'port_id': '6404f751-2813-4de0-aa94-89a7df49823a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 121, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'mac_address': 'fa:16:3e:ff:97:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T14:55:11Z', 'updated_at': '2021-11-12T14:55:50Z', 'revision_number': 1, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:55:51.996329 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52bd3c62-0b44-400a-a0ce-e1e2f43de49e None None] The sync data for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi is: [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '48ff26c1-7f96-4175-96c9-7a0a9c6a28ba', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'floating_ip_address': '172.27.3.9', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'port_id': '6404f751-2813-4de0-aa94-89a7df49823a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 121, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'mac_address': 'fa:16:3e:ff:97:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T14:55:11Z', 'updated_at': '2021-11-12T14:55:50Z', 'revision_number': 1, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:55:52.093900 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3bbdf783-f6ff-45e0-84c0-fafc038c5c4e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:52.199001 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b2428651-fdda-4ed6-8ad1-6ad1b6516ac6 None None] New status for floating IP 48ff26c1-7f96-4175-96c9-7a0a9c6a28ba: ACTIVE {{(pid=101619) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 14:55:52.641795 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28609ee1-4bb2-481e-94b8-26afb70dbb3b req-f72a6f98-11b1-482e-879e-5ce6b1ac180f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:52.643217 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-28609ee1-4bb2-481e-94b8-26afb70dbb3b req-f72a6f98-11b1-482e-879e-5ce6b1ac180f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0483363 Nov 12 14:55:52.691305 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-28609ee1-4bb2-481e-94b8-26afb70dbb3b req-3af56026-e78f-4d70-ad9c-a04ae2787741 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415750 Nov 12 14:55:53.466080 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-b229c17b-285b-474a-a8df-26e372bd907e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:53.467563 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-b229c17b-285b-474a-a8df-26e372bd907e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 1099 time: 0.0411131 Nov 12 14:55:53.563696 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-78415e4c-0643-4f52-9c83-579ddc1d9e0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:53.565434 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-78415e4c-0643-4f52-9c83-579ddc1d9e0f service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 1098 time: 0.0952139 Nov 12 14:55:53.729751 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-329eb771-bf93-47a4-a4fd-a9c2a5759f7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:53.731339 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-329eb771-bf93-47a4-a4fd-a9c2a5759f7f service neutron] 10.222.0.86 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 912 time: 0.2296338 Nov 12 14:55:53.751242 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-8517268a-a534-428c-950f-d3659c03cf9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:53.752749 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-8517268a-a534-428c-950f-d3659c03cf9b service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 919 time: 0.1553714 Nov 12 14:55:53.867281 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-43596507-de4d-4d3e-b510-b5326e9972c8 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=116218b4-72d9-40d7-bcaf-24faa7227810 HTTP/1.1" status: 200 len: 217 time: 0.0770471 Nov 12 14:55:53.951076 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-ebc11b49-b749-4891-bac3-4b1971418fba service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6404f751-2813-4de0-aa94-89a7df49823a HTTP/1.1" status: 200 len: 1000 time: 0.1618547 Nov 12 14:55:53.961270 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce39e492-ed96-4fcf-9421-fd7881e5591d req-5e671fa8-6444-49c4-90c6-53d4707ce1f4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:53.962884 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ce39e492-ed96-4fcf-9421-fd7881e5591d req-5e671fa8-6444-49c4-90c6-53d4707ce1f4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.2033913 Nov 12 14:55:54.011039 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-95c44de5-1ea4-4f72-9af7-360f1548330f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:54.012600 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-95c44de5-1ea4-4f72-9af7-360f1548330f service neutron] 10.222.0.86 "GET /v2.0/subnets?id=03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 200 len: 858 time: 0.1300688 Nov 12 14:55:54.052381 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-a7c2896e-e251-40d4-845e-7fb39b2fb372 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:54.053755 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-a7c2896e-e251-40d4-845e-7fb39b2fb372 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 200 len: 850 time: 0.0866997 Nov 12 14:55:54.070698 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-4c57a492-1293-476d-85ae-5c612f9d5179 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0363111 Nov 12 14:55:54.132871 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ce39e492-ed96-4fcf-9421-fd7881e5591d req-9c1d16b3-6def-4f08-a04c-73249dbbf40a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1530237 Nov 12 14:55:54.184760 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-13b02ef5-cd30-4ef2-90eb-4f58544ade53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:54.186276 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-13b02ef5-cd30-4ef2-90eb-4f58544ade53 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1178820 Nov 12 14:55:54.230871 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-61ca983e-23d0-4abe-ba9f-cbecf2314746 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311605 Nov 12 14:55:54.358919 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-09cae44a-bb5b-4cea-a110-29cba391f2b6 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1602776 Nov 12 14:55:54.385799 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3286e006-ea08-4ae1-a8d6-77d00634cf70 req-65b579ed-9f43-4fdc-a5ab-30c0fa7736f7 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1262221 Nov 12 14:55:54.473990 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-689a8782-4de6-4d84-8ee5-a32e002f79e4 req-6f388ed9-c8e0-43f4-96dc-35840c4538b5 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1009963 Nov 12 14:55:54.528592 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-85503edc-8148-449d-980d-07238f62bd74 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.065894 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54524) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:55.179165 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.285899 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd0d50d-9d5e-4b21-8a3f-613c29561729 req-b473cff4-c27f-44ec-bd55-d3aafea9316a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:55.287247 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cfd0d50d-9d5e-4b21-8a3f-613c29561729 req-b473cff4-c27f-44ec-bd55-d3aafea9316a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0754716 Nov 12 14:55:55.305900 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.315622 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.374053 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=73672710e9224b84a5467961046c3c0b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3070655 Nov 12 14:55:55.376789 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54530) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:55.377800 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37a0f157-a21e-4154-86b8-92e29a328e95,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:55.388400 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.389018 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.389359 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.389716 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.390163 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.390500 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.390826 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.391153 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.391479 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.391823 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.392174 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.392494 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dd37847-149e-42e2-8776-52852f8a060f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.399533 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cfd0d50d-9d5e-4b21-8a3f-613c29561729 req-1f49ee20-ae54-484f-b716-2f33b5226332 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1037469 Nov 12 14:55:55.430423 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.451776 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.497498 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.502181 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.503868 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/37a0f157-a21e-4154-86b8-92e29a328e95 HTTP/1.1" status: 204 len: 168 time: 0.1259952 Nov 12 14:55:55.505531 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.513667 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37a0f157-a21e-4154-86b8-92e29a328e95,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:55.521307 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.521646 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.521983 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.522861 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.523185 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.523510 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.523830 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.524179 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.524500 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.524930 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.525248 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.525562 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b74158f-a8d5-45c6-9afd-8c3b4dc8c5c4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:55:55.820630 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54546) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:55.836665 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ec390162-d870-48cc-8e87-fd781e285a41 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.944692 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ec390162-d870-48cc-8e87-fd781e285a41 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.953787 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ec390162-d870-48cc-8e87-fd781e285a41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:55.993209 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-ec390162-d870-48cc-8e87-fd781e285a41 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=bc80bc3e202544d48b7e929f4d178a13&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1711869 Nov 12 14:55:55.995339 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec390162-d870-48cc-8e87-fd781e285a41 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f18d26d2-6b07-4ea5-b542-f68a7a177308,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:55.995892 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54566) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:56.073551 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fd6bc9d-66e8-4fc2-8b9a-4353bbf0c910 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:56.106459 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fd6bc9d-66e8-4fc2-8b9a-4353bbf0c910 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:56.172394 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fd6bc9d-66e8-4fc2-8b9a-4353bbf0c910 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:56.179509 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fd6bc9d-66e8-4fc2-8b9a-4353bbf0c910 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:56.180931 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6fd6bc9d-66e8-4fc2-8b9a-4353bbf0c910 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f18d26d2-6b07-4ea5-b542-f68a7a177308 HTTP/1.1" status: 204 len: 168 time: 0.1839597 Nov 12 14:55:56.193238 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd6bc9d-66e8-4fc2-8b9a-4353bbf0c910 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f18d26d2-6b07-4ea5-b542-f68a7a177308,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:56.558918 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e1ce94-9757-41c2-b663-ceeb77a08486 req-03564f29-f642-4aa8-8847-b568aefb4bb1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:56.560913 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a5e1ce94-9757-41c2-b663-ceeb77a08486 req-03564f29-f642-4aa8-8847-b568aefb4bb1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0769637 Nov 12 14:55:56.598153 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54600) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:56.651835 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a5e1ce94-9757-41c2-b663-ceeb77a08486 req-34ff2baa-b8dc-48e7-87b7-2e637881013e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797849 Nov 12 14:55:56.768341 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-51a41895-4e1d-43b7-bddb-e8228636f277 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:56.869900 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-51a41895-4e1d-43b7-bddb-e8228636f277 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:56.873980 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-51a41895-4e1d-43b7-bddb-e8228636f277 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:56.912248 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:56.922347 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-51a41895-4e1d-43b7-bddb-e8228636f277 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=869b42c3e8c7431d99af4036b6e84b11&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3229315 Nov 12 14:55:56.926254 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54616) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:56.928865 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a41895-4e1d-43b7-bddb-e8228636f277 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82a80d2a-927d-4557-992b-49e927cc5796,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:57.006159 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-64e52205-2600-4c87-b352-a82efdac8e04 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.029882 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-64e52205-2600-4c87-b352-a82efdac8e04 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.094292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-64e52205-2600-4c87-b352-a82efdac8e04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.096986 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-64e52205-2600-4c87-b352-a82efdac8e04 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.098132 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-64e52205-2600-4c87-b352-a82efdac8e04 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/82a80d2a-927d-4557-992b-49e927cc5796 HTTP/1.1" status: 204 len: 168 time: 0.1699760 Nov 12 14:55:57.109451 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e52205-2600-4c87-b352-a82efdac8e04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82a80d2a-927d-4557-992b-49e927cc5796,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:57.345864 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:55:57.528652 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54654) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:57.548261 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7953baf8-2bd9-4c24-aa4e-b5b22c922c51 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.635175 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7953baf8-2bd9-4c24-aa4e-b5b22c922c51 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.644248 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7953baf8-2bd9-4c24-aa4e-b5b22c922c51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.695109 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54664) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:57.713152 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-7953baf8-2bd9-4c24-aa4e-b5b22c922c51 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a7c2ddba0c58432db7ad797a3943c507&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1765668 Nov 12 14:55:57.713152 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7953baf8-2bd9-4c24-aa4e-b5b22c922c51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=413a450f-5c67-4ae0-a0b3-f1d7a32ba105,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:57.713714 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54668) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:57.812736 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2dc92cdd-587c-402d-a255-31868dc7985e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.825202 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae7c433d-ce2f-4fa5-bbd1-248a9e7a68a1 req-65fe0759-fbc6-4ac3-ad66-5c2e0209e623 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:57.826697 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ae7c433d-ce2f-4fa5-bbd1-248a9e7a68a1 req-65fe0759-fbc6-4ac3-ad66-5c2e0209e623 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0888803 Nov 12 14:55:57.836948 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-33e5d199-e329-48d4-b9cf-76e21dbb0fdc admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.860060 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2dc92cdd-587c-402d-a255-31868dc7985e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.889067 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.917906 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ae7c433d-ce2f-4fa5-bbd1-248a9e7a68a1 req-cf31a1d5-4707-45be-8bc7-57384f93b0f9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844522 Nov 12 14:55:57.935034 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-33e5d199-e329-48d4-b9cf-76e21dbb0fdc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.939917 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-33e5d199-e329-48d4-b9cf-76e21dbb0fdc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.942813 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2dc92cdd-587c-402d-a255-31868dc7985e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.945609 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2dc92cdd-587c-402d-a255-31868dc7985e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:57.946829 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-2dc92cdd-587c-402d-a255-31868dc7985e admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/413a450f-5c67-4ae0-a0b3-f1d7a32ba105 HTTP/1.1" status: 204 len: 168 time: 0.2324288 Nov 12 14:55:57.959028 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dc92cdd-587c-402d-a255-31868dc7985e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=413a450f-5c67-4ae0-a0b3-f1d7a32ba105,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:57.991818 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-33e5d199-e329-48d4-b9cf-76e21dbb0fdc admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=6c4b6814f2df4cb9ab9b1baacf4963cc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2924278 Nov 12 14:55:57.991818 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e5d199-e329-48d4-b9cf-76e21dbb0fdc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a96da25-c9a9-459e-9a3f-e3282f9d8f7b,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:57.992312 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54674) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:58.052030 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4f89f75d-eb70-4200-9726-dc5292d0539b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:58.074530 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4f89f75d-eb70-4200-9726-dc5292d0539b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:58.132675 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4f89f75d-eb70-4200-9726-dc5292d0539b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:58.135660 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4f89f75d-eb70-4200-9726-dc5292d0539b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:58.136883 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-4f89f75d-eb70-4200-9726-dc5292d0539b admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/4a96da25-c9a9-459e-9a3f-e3282f9d8f7b HTTP/1.1" status: 204 len: 168 time: 0.1435485 Nov 12 14:55:58.149228 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f89f75d-eb70-4200-9726-dc5292d0539b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a96da25-c9a9-459e-9a3f-e3282f9d8f7b,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:59.078270 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18364cc4-0266-437b-a648-b2eedc8b039b req-86558535-3660-4f5d-895f-93d06d1e42a7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:55:59.087056 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18364cc4-0266-437b-a648-b2eedc8b039b req-86558535-3660-4f5d-895f-93d06d1e42a7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0785940 Nov 12 14:55:59.151756 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18364cc4-0266-437b-a648-b2eedc8b039b req-740a3b9f-4fca-4844-a899-d90567ed180c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630488 Nov 12 14:55:59.614118 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54764) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:59.726576 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b8b4e97d-e0ad-4371-bea1-5aad9be51b19 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:59.821425 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b8b4e97d-e0ad-4371-bea1-5aad9be51b19 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:59.826481 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b8b4e97d-e0ad-4371-bea1-5aad9be51b19 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:59.866349 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b8b4e97d-e0ad-4371-bea1-5aad9be51b19 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=537c3b3a26d542619aeb5a7d9e59da3f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2510912 Nov 12 14:55:59.867064 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b4e97d-e0ad-4371-bea1-5aad9be51b19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=091b2f1a-1be6-41c1-ad47-6ca8c0dd2381,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:55:59.869224 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54770) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:55:59.924500 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-60f967b0-fde7-4b3b-8f84-a44d3235bec7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:55:59.948405 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-60f967b0-fde7-4b3b-8f84-a44d3235bec7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:00.010021 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-60f967b0-fde7-4b3b-8f84-a44d3235bec7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:00.013089 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-60f967b0-fde7-4b3b-8f84-a44d3235bec7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:00.017338 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-60f967b0-fde7-4b3b-8f84-a44d3235bec7 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/091b2f1a-1be6-41c1-ad47-6ca8c0dd2381 HTTP/1.1" status: 204 len: 168 time: 0.1431110 Nov 12 14:56:00.023573 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f967b0-fde7-4b3b-8f84-a44d3235bec7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=091b2f1a-1be6-41c1-ad47-6ca8c0dd2381,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:00.203675 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54790) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:00.280900 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-741e0404-6138-4e35-b673-d9cfe3ff3c40 req-fce8e031-e8d3-4a59-a4e5-087b71288c38 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:00.289335 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-741e0404-6138-4e35-b673-d9cfe3ff3c40 req-fce8e031-e8d3-4a59-a4e5-087b71288c38 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0729055 Nov 12 14:56:00.622717 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-741e0404-6138-4e35-b673-d9cfe3ff3c40 req-ba7d1e29-dd99-4fd2-a1e5-23bd3c243b99 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3322821 Nov 12 14:56:00.676207 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93dfbf2c-0f23-47d5-b0fa-daea383c5989 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:00.858766 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93dfbf2c-0f23-47d5-b0fa-daea383c5989 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:00.865801 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93dfbf2c-0f23-47d5-b0fa-daea383c5989 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:00.870174 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-a77fb91e-a1c0-44a8-8567-79ca3f921a71 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0845509 Nov 12 14:56:00.916411 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54836) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:00.917152 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-93dfbf2c-0f23-47d5-b0fa-daea383c5989 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=89d4f80649794e10a8a1666a2dc8680c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7123077 Nov 12 14:56:00.920269 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93dfbf2c-0f23-47d5-b0fa-daea383c5989 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40bf54f6-ca5c-4f9f-b005-5e992e563dc5,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:01.014612 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6d9006f5-64d4-4a05-9755-1896bc9d3695 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:01.024300 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-fde2c8bf-5a15-4e24-ab59-ad611e3baa60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:01.025735 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-fde2c8bf-5a15-4e24-ab59-ad611e3baa60 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c5cd628706954cf7a4c6ff4180751364&device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 1099 time: 0.0756869 Nov 12 14:56:01.049490 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6d9006f5-64d4-4a05-9755-1896bc9d3695 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:01.181387 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6d9006f5-64d4-4a05-9755-1896bc9d3695 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:01.184077 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6d9006f5-64d4-4a05-9755-1896bc9d3695 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:01.187034 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-6d9006f5-64d4-4a05-9755-1896bc9d3695 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/40bf54f6-ca5c-4f9f-b005-5e992e563dc5 HTTP/1.1" status: 204 len: 168 time: 0.2682703 Nov 12 14:56:01.190254 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-8cd27b61-fbfc-4d33-8ab9-cf9177452665 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:01.191751 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-8cd27b61-fbfc-4d33-8ab9-cf9177452665 service neutron] 10.222.0.86 "GET /v2.0/networks?id=c99d116e-3040-4028-8675-ad12dd87958d HTTP/1.1" status: 200 len: 913 time: 0.1310475 Nov 12 14:56:01.198498 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d9006f5-64d4-4a05-9755-1896bc9d3695 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40bf54f6-ca5c-4f9f-b005-5e992e563dc5,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:01.255933 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-a11b0a5f-589f-48f0-9162-d10c3a928a53 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=1f15370a-838b-414a-9824-824840a9315d HTTP/1.1" status: 200 len: 217 time: 0.0456059 Nov 12 14:56:01.321264 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-ceed8817-5700-4204-a8bd-271cbc7af05e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:01.322981 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-ceed8817-5700-4204-a8bd-271cbc7af05e service neutron] 10.222.0.86 "GET /v2.0/subnets?id=dd2d4dae-b732-4123-90af-8645300420da HTTP/1.1" status: 200 len: 852 time: 0.0514975 Nov 12 14:56:01.365190 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-a934a238-87dd-4bf4-b0c3-a8c48b4a56f1 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c99d116e-3040-4028-8675-ad12dd87958d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0274839 Nov 12 14:56:01.496409 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-3f57e5ef-15e3-4b1b-b4c0-de27cfc4c671 service neutron] 10.222.0.86 "GET /v2.0/networks/c99d116e-3040-4028-8675-ad12dd87958d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1220415 Nov 12 14:56:01.606734 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30dbae71-61ca-4440-a1bb-2938134dda9a req-4d85c98f-ad24-4d56-be23-e14e20713166 service neutron] 10.222.0.86 "GET /v2.0/networks/c99d116e-3040-4028-8675-ad12dd87958d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0962660 Nov 12 14:56:01.638551 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 54852) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:01.656922 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07382d3d-60a5-4457-987a-67ac37005b1f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:01.823802 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07382d3d-60a5-4457-987a-67ac37005b1f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:01.840957 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75cd2208-f74b-4857-9ef2-c7f89ea7e345 req-49b0a362-d20c-4ba0-81f1-6c5fa09982b5 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:01.846923 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75cd2208-f74b-4857-9ef2-c7f89ea7e345 req-49b0a362-d20c-4ba0-81f1-6c5fa09982b5 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1223323 Nov 12 14:56:01.848807 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07382d3d-60a5-4457-987a-67ac37005b1f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:01.929338 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-07382d3d-60a5-4457-987a-67ac37005b1f admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=38d04f6da24b44fd924989768ef46927&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2895834 Nov 12 14:56:01.933854 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 54870) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:01.957277 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07382d3d-60a5-4457-987a-67ac37005b1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c4bada1-97e1-4072-a802-21d353ccbaf9,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:01.983649 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75cd2208-f74b-4857-9ef2-c7f89ea7e345 req-b81e874d-c550-47fa-b8e5-0ae7b74f8f11 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1159310 Nov 12 14:56:02.008998 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2fe90266-6e90-40f5-88f3-ee07467bc569 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:02.036834 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2fe90266-6e90-40f5-88f3-ee07467bc569 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:02.118322 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2fe90266-6e90-40f5-88f3-ee07467bc569 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:02.123656 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2fe90266-6e90-40f5-88f3-ee07467bc569 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:02.129602 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-2fe90266-6e90-40f5-88f3-ee07467bc569 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1c4bada1-97e1-4072-a802-21d353ccbaf9 HTTP/1.1" status: 204 len: 168 time: 0.1940427 Nov 12 14:56:02.138640 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fe90266-6e90-40f5-88f3-ee07467bc569 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c4bada1-97e1-4072-a802-21d353ccbaf9,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:03.116887 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0c1390-3a88-4e21-b5c6-ba2f19559ba5 req-e2341907-55ab-4aef-a9d6-ba072ea8de07 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:03.118490 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea0c1390-3a88-4e21-b5c6-ba2f19559ba5 req-e2341907-55ab-4aef-a9d6-ba072ea8de07 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0530393 Nov 12 14:56:03.176825 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea0c1390-3a88-4e21-b5c6-ba2f19559ba5 req-d8255499-fb6f-4408-ae27-44e8908e9943 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498936 Nov 12 14:56:03.631541 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed61a9f0-48db-49ee-b9e5-c1a63fb359e0 req-1d56398d-6a74-46a3-b6b3-f89440d816ea tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:03.633074 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ed61a9f0-48db-49ee-b9e5-c1a63fb359e0 req-1d56398d-6a74-46a3-b6b3-f89440d816ea tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0549295 Nov 12 14:56:03.701799 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ed61a9f0-48db-49ee-b9e5-c1a63fb359e0 req-4d608d4b-120f-4b6a-9f6c-dabcba889d37 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579815 Nov 12 14:56:04.321712 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aedca8e8-ab78-43ee-835c-59ff6686eede req-3cb27c0c-113c-4bd9-addd-e1b79bdab6cb tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:04.323346 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aedca8e8-ab78-43ee-835c-59ff6686eede req-3cb27c0c-113c-4bd9-addd-e1b79bdab6cb tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0614011 Nov 12 14:56:04.377125 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aedca8e8-ab78-43ee-835c-59ff6686eede req-7ebed475-7708-4094-82d2-0d7c0b6aff95 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469170 Nov 12 14:56:04.759431 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55024) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:04.866562 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75b01ec-9edf-4c8f-a100-0f7030c341eb req-f52384e9-fda6-49ac-b33a-652fe033a96d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:04.869414 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a75b01ec-9edf-4c8f-a100-0f7030c341eb req-f52384e9-fda6-49ac-b33a-652fe033a96d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0638788 Nov 12 14:56:04.900466 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f5453d65-1151-4541-8378-fa5a759df405 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:04.934342 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:04.941853 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a75b01ec-9edf-4c8f-a100-0f7030c341eb req-fca2324a-0379-4d56-931a-ee11f9710741 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679684 Nov 12 14:56:04.999331 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f5453d65-1151-4541-8378-fa5a759df405 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.005154 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f5453d65-1151-4541-8378-fa5a759df405 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.047218 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5453d65-1151-4541-8378-fa5a759df405 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32ea94fb-f83c-42d8-b1df-4b8df2c07e8d,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:05.053470 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f5453d65-1151-4541-8378-fa5a759df405 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=531f997e6cf84634bf975642e79284aa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2927387 Nov 12 14:56:05.056267 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55038) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:05.106853 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7026ae1-8607-48d2-bf32-99cfc63e5f13 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.129377 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7026ae1-8607-48d2-bf32-99cfc63e5f13 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.178050 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7026ae1-8607-48d2-bf32-99cfc63e5f13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.180816 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7026ae1-8607-48d2-bf32-99cfc63e5f13 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.181987 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e7026ae1-8607-48d2-bf32-99cfc63e5f13 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/32ea94fb-f83c-42d8-b1df-4b8df2c07e8d HTTP/1.1" status: 204 len: 168 time: 0.1247518 Nov 12 14:56:05.190625 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7026ae1-8607-48d2-bf32-99cfc63e5f13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32ea94fb-f83c-42d8-b1df-4b8df2c07e8d,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:05.460999 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55048) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:05.488410 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7bd873b2-1e5e-48c6-9dfb-c4f90ffb89bd admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.528029 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adc43fa8-c1fd-496e-baee-fd1882473bf3 req-7907087d-a94f-49c1-a1b6-e08fc70e9efe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:05.529459 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-adc43fa8-c1fd-496e-baee-fd1882473bf3 req-7907087d-a94f-49c1-a1b6-e08fc70e9efe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0798564 Nov 12 14:56:05.602881 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-adc43fa8-c1fd-496e-baee-fd1882473bf3 req-5d8d5b2b-ac4c-4fa3-b84d-f30baa9c41a3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664420 Nov 12 14:56:05.625537 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7bd873b2-1e5e-48c6-9dfb-c4f90ffb89bd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.631079 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7bd873b2-1e5e-48c6-9dfb-c4f90ffb89bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.671897 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-7bd873b2-1e5e-48c6-9dfb-c4f90ffb89bd admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=189ef3d45e284e99a6a9427780d0fd8e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2098577 Nov 12 14:56:05.672676 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bd873b2-1e5e-48c6-9dfb-c4f90ffb89bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=add3a63b-88ed-4dbf-b3d5-3466d0f4ab8f,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:05.674876 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55052) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:05.737898 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-25e4595b-e27f-4838-980e-06518beb0c5a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.761521 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-25e4595b-e27f-4838-980e-06518beb0c5a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.821789 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-25e4595b-e27f-4838-980e-06518beb0c5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.824273 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-25e4595b-e27f-4838-980e-06518beb0c5a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:05.825498 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-25e4595b-e27f-4838-980e-06518beb0c5a admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/add3a63b-88ed-4dbf-b3d5-3466d0f4ab8f HTTP/1.1" status: 204 len: 168 time: 0.1494257 Nov 12 14:56:05.833862 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25e4595b-e27f-4838-980e-06518beb0c5a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=add3a63b-88ed-4dbf-b3d5-3466d0f4ab8f,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:06.085108 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bf3f3ca-7744-42f0-8cd8-52f459731bd2 req-c6ce1091-b6c6-40eb-8904-731118a15293 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:06.086784 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6bf3f3ca-7744-42f0-8cd8-52f459731bd2 req-c6ce1091-b6c6-40eb-8904-731118a15293 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0585978 Nov 12 14:56:06.164455 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6bf3f3ca-7744-42f0-8cd8-52f459731bd2 req-1d75dea8-5246-4712-8e99-f16c6f86b716 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662696 Nov 12 14:56:06.740382 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf41279-caeb-4f30-bbc1-5e37349e47a7 req-ca7418f0-cd19-4dd5-91fe-7ab9e81faabe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:06.742207 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7cf41279-caeb-4f30-bbc1-5e37349e47a7 req-ca7418f0-cd19-4dd5-91fe-7ab9e81faabe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0619478 Nov 12 14:56:06.835102 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7cf41279-caeb-4f30-bbc1-5e37349e47a7 req-cbbb8a3e-8822-4bdb-9a1d-8c14f1a5636b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798714 Nov 12 14:56:07.059398 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55098) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:07.228690 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7111b94-7b56-48e7-bbb8-9fb401f652a9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:07.352613 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc6dd2d-a4a1-4f12-ae8b-0c2477cd34fb req-98477919-8f07-4d0b-aa83-a83def94f4b6 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:07.354275 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8dc6dd2d-a4a1-4f12-ae8b-0c2477cd34fb req-98477919-8f07-4d0b-aa83-a83def94f4b6 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0895226 Nov 12 14:56:07.390240 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7111b94-7b56-48e7-bbb8-9fb401f652a9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:07.399690 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7111b94-7b56-48e7-bbb8-9fb401f652a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:07.459454 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8dc6dd2d-a4a1-4f12-ae8b-0c2477cd34fb req-6191110f-cc1b-442b-83c1-487f7062959d tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961118 Nov 12 14:56:07.464753 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e7111b94-7b56-48e7-bbb8-9fb401f652a9 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e3c1103a9f0041449584f834bb5f657d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4037726 Nov 12 14:56:07.466376 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7111b94-7b56-48e7-bbb8-9fb401f652a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3569f5df-4160-4384-aafb-6d5b5c64c1b7,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:07.469126 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55130) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:07.540053 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a3c00a47-911b-46b6-8126-740011a44d7a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:07.568096 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a3c00a47-911b-46b6-8126-740011a44d7a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:07.640766 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a3c00a47-911b-46b6-8126-740011a44d7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:07.643992 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a3c00a47-911b-46b6-8126-740011a44d7a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:07.645749 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-a3c00a47-911b-46b6-8126-740011a44d7a admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/3569f5df-4160-4384-aafb-6d5b5c64c1b7 HTTP/1.1" status: 204 len: 168 time: 0.1749005 Nov 12 14:56:07.654251 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c00a47-911b-46b6-8126-740011a44d7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3569f5df-4160-4384-aafb-6d5b5c64c1b7,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:07.838191 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55144) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:08.034248 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c3d6d6-81ba-427f-acb3-30b61bf233ca req-b9c74ee0-3e03-42e3-8e43-27db430ba5e3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:08.037063 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-92c3d6d6-81ba-427f-acb3-30b61bf233ca req-b9c74ee0-3e03-42e3-8e43-27db430ba5e3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0890915 Nov 12 14:56:08.045530 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55150) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:08.059341 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85ee4705-1073-475e-845d-7b68908fcdef admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.061867 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-04a1618b-635b-4358-b3c7-9c2d68777ead admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.122391 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-92c3d6d6-81ba-427f-acb3-30b61bf233ca req-ae48d8d7-819a-4ee8-a687-eeb10fac5da4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728509 Nov 12 14:56:08.167773 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85ee4705-1073-475e-845d-7b68908fcdef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.178208 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85ee4705-1073-475e-845d-7b68908fcdef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.206696 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-04a1618b-635b-4358-b3c7-9c2d68777ead admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.212997 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-04a1618b-635b-4358-b3c7-9c2d68777ead admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.242321 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-85ee4705-1073-475e-845d-7b68908fcdef admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=6b1d5c4381da4195a5bbcd4904d49431&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1956155 Nov 12 14:56:08.243254 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55158) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:08.244133 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85ee4705-1073-475e-845d-7b68908fcdef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=193c9ee9-bb6c-4787-b8d3-43e10baed881,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:08.264246 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-04a1618b-635b-4358-b3c7-9c2d68777ead admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=2cf4c44d462c4af086b7223bf3e416e0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4244437 Nov 12 14:56:08.266905 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55160) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:08.312693 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4f32309a-898d-43bd-a2dd-e9e9031b0567 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.335786 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04a1618b-635b-4358-b3c7-9c2d68777ead admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32562561-be2f-4c91-bfd8-870213ac5c08,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:08.337588 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4f32309a-898d-43bd-a2dd-e9e9031b0567 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.365699 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6f8f8799-ee4a-44ed-a8d2-4eccf98b575d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.400307 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6f8f8799-ee4a-44ed-a8d2-4eccf98b575d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.412171 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4f32309a-898d-43bd-a2dd-e9e9031b0567 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.415070 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4f32309a-898d-43bd-a2dd-e9e9031b0567 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.416218 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-4f32309a-898d-43bd-a2dd-e9e9031b0567 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/193c9ee9-bb6c-4787-b8d3-43e10baed881 HTTP/1.1" status: 204 len: 168 time: 0.1688750 Nov 12 14:56:08.435922 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f32309a-898d-43bd-a2dd-e9e9031b0567 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=193c9ee9-bb6c-4787-b8d3-43e10baed881,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:08.475989 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6f8f8799-ee4a-44ed-a8d2-4eccf98b575d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.480938 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6f8f8799-ee4a-44ed-a8d2-4eccf98b575d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:08.483342 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-6f8f8799-ee4a-44ed-a8d2-4eccf98b575d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/32562561-be2f-4c91-bfd8-870213ac5c08 HTTP/1.1" status: 204 len: 168 time: 0.2148695 Nov 12 14:56:08.495895 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f8f8799-ee4a-44ed-a8d2-4eccf98b575d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32562561-be2f-4c91-bfd8-870213ac5c08,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:08.670767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2bdbd58-24ff-40ff-8856-cbebbe489ba7 req-376b47e3-f732-4ecd-9bd9-210ba4f36a36 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:08.673648 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d2bdbd58-24ff-40ff-8856-cbebbe489ba7 req-376b47e3-f732-4ecd-9bd9-210ba4f36a36 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0809865 Nov 12 14:56:08.748389 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d2bdbd58-24ff-40ff-8856-cbebbe489ba7 req-1addf20e-9c5c-49d8-b43a-e01676b29abf tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598664 Nov 12 14:56:08.914374 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55178) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:08.928609 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f9131dd3-2d82-4c9c-af9a-5b44a707c660 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:09.025305 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f9131dd3-2d82-4c9c-af9a-5b44a707c660 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:09.030381 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f9131dd3-2d82-4c9c-af9a-5b44a707c660 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:09.083292 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f9131dd3-2d82-4c9c-af9a-5b44a707c660 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d27bb18b17514b5081db87fac58298d7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1632719 Nov 12 14:56:09.083794 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55182) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:09.088072 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9131dd3-2d82-4c9c-af9a-5b44a707c660 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0eb0ade9-397c-409f-bcd1-cc17998cae3d,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:09.150569 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-832163c4-805f-4530-b076-f9a71eb389f7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:09.175718 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-832163c4-805f-4530-b076-f9a71eb389f7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:09.261892 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-832163c4-805f-4530-b076-f9a71eb389f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:09.265623 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-832163c4-805f-4530-b076-f9a71eb389f7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:09.267768 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-832163c4-805f-4530-b076-f9a71eb389f7 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/0eb0ade9-397c-409f-bcd1-cc17998cae3d HTTP/1.1" status: 204 len: 168 time: 0.1826255 Nov 12 14:56:09.299299 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-832163c4-805f-4530-b076-f9a71eb389f7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0eb0ade9-397c-409f-bcd1-cc17998cae3d,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:09.351850 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e48974-7354-478e-96ed-72da1f90fe77 req-e0019c37-586f-4c69-ae13-473568fb0809 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:09.364504 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18e48974-7354-478e-96ed-72da1f90fe77 req-e0019c37-586f-4c69-ae13-473568fb0809 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1258805 Nov 12 14:56:09.440253 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18e48974-7354-478e-96ed-72da1f90fe77 req-11a30c16-949d-463a-bcd5-b8a02594d4d7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732729 Nov 12 14:56:09.979208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbd2696-ada4-42c5-92c6-6c45eb6840f1 req-3fb798cc-2cf3-4904-9cbd-940e41c50cde tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:09.981983 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ecbd2696-ada4-42c5-92c6-6c45eb6840f1 req-3fb798cc-2cf3-4904-9cbd-940e41c50cde tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.1127837 Nov 12 14:56:10.066292 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ecbd2696-ada4-42c5-92c6-6c45eb6840f1 req-a2cba10e-7db5-4bfd-82cf-11706a40b8ce tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703900 Nov 12 14:56:10.622107 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6c1141-7907-4133-bd59-87026c796cce req-9c33a391-5a00-44b8-b441-7f1b615df138 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:10.624869 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea6c1141-7907-4133-bd59-87026c796cce req-9c33a391-5a00-44b8-b441-7f1b615df138 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0905430 Nov 12 14:56:10.704588 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea6c1141-7907-4133-bd59-87026c796cce req-3776d0b2-0f9f-4e90-af94-10ce411d7720 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690608 Nov 12 14:56:11.287650 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7d276f-28b6-4879-8922-277a53a2b877 req-f8c34a6e-d930-4dcc-8fab-7da5d57fd679 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:11.292724 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9f7d276f-28b6-4879-8922-277a53a2b877 req-f8c34a6e-d930-4dcc-8fab-7da5d57fd679 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0882804 Nov 12 14:56:11.374094 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9f7d276f-28b6-4879-8922-277a53a2b877 req-f8b4dc92-6c95-4d13-b400-ad77e84ecb0c tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/security-groups?id=1d806b9c-55a2-4517-9ffc-a15fbecdc272&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712073 Nov 12 14:56:11.551133 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-7f34ad6f-fba5-4418-8463-d2789ef7c455 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:11.552682 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-7f34ad6f-fba5-4418-8463-d2789ef7c455 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.86 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 946 time: 0.0557053 Nov 12 14:56:11.752157 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Deleting port 1f15370a-838b-414a-9824-824840a9315d {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:56:11.752599 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:11.911123 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] For port 1f15370a-838b-414a-9824-824840a9315d, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1f15370a-838b-414a-9824-824840a9315d,segment=NetworkSegment(596317c1-3ea0-41df-b1b0-0fd9146ab825),segment_id=596317c1-3ea0-41df-b1b0-0fd9146ab825)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:56:11.911687 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:11.934777 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Calling delete_port for 1f15370a-838b-414a-9824-824840a9315d owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:56:11.942018 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b55d53d-75d0-4b2b-bd2d-507ade8171e3 req-e3a5e336-3fed-40a5-886d-60e6e9a173fd tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:11.943725 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6b55d53d-75d0-4b2b-bd2d-507ade8171e3 req-e3a5e336-3fed-40a5-886d-60e6e9a173fd tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0855901 Nov 12 14:56:12.057476 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6b55d53d-75d0-4b2b-bd2d-507ade8171e3 req-5e0713f7-4d55-43a9-a728-8f5a999a5fb2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039681 Nov 12 14:56:12.213841 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:12.234867 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['1f15370a-838b-414a-9824-824840a9315d'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:56:12.248796 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Pushing event deleted for resources: {'Port': ['ID=1f15370a-838b-414a-9824-824840a9315d,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:12.342165 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] No DVR routers for this DVR port 1f15370a-838b-414a-9824-824840a9315d on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 14:56:12.354081 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:12.358004 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-42a33171-3cc8-4c23-8d8f-7674dfd70e46 req-3be3bf13-d2f6-4921-8507-4b73e7d8eafd tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.86 "DELETE /v2.0/ports/1f15370a-838b-414a-9824-824840a9315d HTTP/1.1" status: 204 len: 173 time: 0.7906535 Nov 12 14:56:12.358596 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '689a1fb3-9828-439c-a3c6-d5c86bbfe89a', 'name': 'network-vif-deleted', 'tag': '1f15370a-838b-414a-9824-824840a9315d'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:56:12.362464 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93826897-d116-422a-bef9-d2ddf058563b" -d '{"events": [{"server_uuid": "689a1fb3-9828-439c-a3c6-d5c86bbfe89a", "name": "network-vif-deleted", "tag": "1f15370a-838b-414a-9824-824840a9315d"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:56:12.427322 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:56:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ef1044f-ed6e-4e14-982a-22db601a3adc x-openstack-request-id: req-6ef1044f-ed6e-4e14-982a-22db601a3adc {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:56:12.427721 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "689a1fb3-9828-439c-a3c6-d5c86bbfe89a", "name": "network-vif-deleted", "tag": "1f15370a-838b-414a-9824-824840a9315d", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:56:12.428023 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-6ef1044f-ed6e-4e14-982a-22db601a3adc {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:56:12.428490 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '689a1fb3-9828-439c-a3c6-d5c86bbfe89a', 'name': 'network-vif-deleted', 'tag': '1f15370a-838b-414a-9824-824840a9315d', 'status': 'completed', 'code': 200} Nov 12 14:56:12.514797 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7d2c3e23-0a5e-47b5-a2d7-ef09d6328b46 req-a7c03708-e9e6-4b59-b172-3ac1ec39028b tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.0349181 Nov 12 14:56:12.932988 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55344) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:13.101706 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7642d79-c776-4782-86f4-622df8d5f7b8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.248652 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157d8d87-e1bb-4abd-b5bc-7c05e86f12f9 req-127e9dee-7037-4299-ab04-89e8c8d093a9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:13.250161 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-157d8d87-e1bb-4abd-b5bc-7c05e86f12f9 req-127e9dee-7037-4299-ab04-89e8c8d093a9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0936010 Nov 12 14:56:13.297357 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7642d79-c776-4782-86f4-622df8d5f7b8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.303797 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e7642d79-c776-4782-86f4-622df8d5f7b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.350817 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-157d8d87-e1bb-4abd-b5bc-7c05e86f12f9 req-592fd57b-d322-4f5d-bbbb-72bf41ad9516 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0928431 Nov 12 14:56:13.360762 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e7642d79-c776-4782-86f4-622df8d5f7b8 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=501f532f7507483d8c054bd8c1ed5898&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4256511 Nov 12 14:56:13.361640 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7642d79-c776-4782-86f4-622df8d5f7b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=891c32fe-c88e-439b-8df6-b97d3b311c53,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:13.363967 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55354) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:13.423649 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8564548a-c719-49ab-bae7-bf11b1b97b68 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.447284 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8564548a-c719-49ab-bae7-bf11b1b97b68 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.496097 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8564548a-c719-49ab-bae7-bf11b1b97b68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.498672 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8564548a-c719-49ab-bae7-bf11b1b97b68 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.499810 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-8564548a-c719-49ab-bae7-bf11b1b97b68 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/891c32fe-c88e-439b-8df6-b97d3b311c53 HTTP/1.1" status: 204 len: 168 time: 0.1349142 Nov 12 14:56:13.507788 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8564548a-c719-49ab-bae7-bf11b1b97b68 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=891c32fe-c88e-439b-8df6-b97d3b311c53,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:13.651258 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1751da07-a5d4-41e5-8105-caea72e7e30a req-84b2d00e-2057-4682-a9c2-67572778ace0 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.0362830 Nov 12 14:56:13.806622 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55368) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:13.821058 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b2a18a4e-662f-4d5b-a274-0f64a9c46ad1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.915290 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b2a18a4e-662f-4d5b-a274-0f64a9c46ad1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.919823 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b2a18a4e-662f-4d5b-a274-0f64a9c46ad1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:13.931387 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55372) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:13.965423 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-b2a18a4e-662f-4d5b-a274-0f64a9c46ad1 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=97d8369a74ec41c8840b9d70c2612949&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1552351 Nov 12 14:56:13.965423 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2a18a4e-662f-4d5b-a274-0f64a9c46ad1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1bff9222-132b-4c1a-96f6-2f6e87e88a99,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:13.966252 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55378) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:14.024380 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-102851bd-ffdd-4b84-97dc-75a0a65b4632 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.059383 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-102851bd-ffdd-4b84-97dc-75a0a65b4632 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.061761 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-dafac7e8-c262-4a6e-8d4d-5421fede3262 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.161903 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-102851bd-ffdd-4b84-97dc-75a0a65b4632 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.164549 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-102851bd-ffdd-4b84-97dc-75a0a65b4632 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.165736 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-102851bd-ffdd-4b84-97dc-75a0a65b4632 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1bff9222-132b-4c1a-96f6-2f6e87e88a99 HTTP/1.1" status: 204 len: 168 time: 0.1983767 Nov 12 14:56:14.186576 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-102851bd-ffdd-4b84-97dc-75a0a65b4632 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1bff9222-132b-4c1a-96f6-2f6e87e88a99,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:14.192815 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-dafac7e8-c262-4a6e-8d4d-5421fede3262 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.210459 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-dafac7e8-c262-4a6e-8d4d-5421fede3262 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.261122 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-dafac7e8-c262-4a6e-8d4d-5421fede3262 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=98ca886d463e4ffba66f3233a3fdb818&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3285944 Nov 12 14:56:14.262203 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dafac7e8-c262-4a6e-8d4d-5421fede3262 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da1df58d-a7f7-4a02-bcf0-875980e94fc5,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:14.264712 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55384) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:14.327794 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fbf9662-8472-4b31-9705-58e09a6395bc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.362665 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fbf9662-8472-4b31-9705-58e09a6395bc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.426993 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fbf9662-8472-4b31-9705-58e09a6395bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.429912 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fbf9662-8472-4b31-9705-58e09a6395bc admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:14.431158 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6fbf9662-8472-4b31-9705-58e09a6395bc admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/da1df58d-a7f7-4a02-bcf0-875980e94fc5 HTTP/1.1" status: 204 len: 168 time: 0.1653502 Nov 12 14:56:14.442716 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fbf9662-8472-4b31-9705-58e09a6395bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da1df58d-a7f7-4a02-bcf0-875980e94fc5,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:14.509504 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-419be5b6-2325-4f2d-af63-6cc750a97db3 req-8c9c995c-c36e-46aa-b5ca-b45a2e3b44e1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:14.511594 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-419be5b6-2325-4f2d-af63-6cc750a97db3 req-8c9c995c-c36e-46aa-b5ca-b45a2e3b44e1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0690169 Nov 12 14:56:14.574628 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-419be5b6-2325-4f2d-af63-6cc750a97db3 req-5214be35-1929-4bc8-a327-4c8bd06a0f54 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494564 Nov 12 14:56:14.783689 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0645cae1-495f-4ec2-a75d-3f5c2127e742 req-117c19c6-b9d7-428c-ab64-017609e25829 tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.0352087 Nov 12 14:56:15.721455 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-208e8db1-441d-4433-ba6f-c15650a4afc2 req-81a0c442-4c92-4f59-b463-8878aa6769cd tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:15.723478 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-208e8db1-441d-4433-ba6f-c15650a4afc2 req-81a0c442-4c92-4f59-b463-8878aa6769cd tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0645378 Nov 12 14:56:15.776896 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-208e8db1-441d-4433-ba6f-c15650a4afc2 req-c682d88f-5441-4b8e-b64f-7fe75bb43077 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467248 Nov 12 14:56:15.913779 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9dce3fc1-5f28-427d-89fd-976059a5b918 req-571bfa45-f5ae-4d98-9382-105e7798487b tempest-DeleteServersTestJSON-11098354 tempest-DeleteServersTestJSON-11098354-project] 10.222.0.61 "GET /v2.0/ports?device_id=689a1fb3-9828-439c-a3c6-d5c86bbfe89a HTTP/1.1" status: 200 len: 210 time: 0.0349164 Nov 12 14:56:16.050738 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1f15370a-838b-414a-9824-824840a9315d no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:56:16.077620 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 1f15370a-838b-414a-9824-824840a9315d {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:56:16.078506 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1f15370a-838b-414a-9824-824840a9315d not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:56:16.910343 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ca884f-e261-4846-9866-ef111ebeeca7 req-2d4cc8a9-7ec4-46cd-9f05-76a29f70cc4a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:16.911987 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10ca884f-e261-4846-9866-ef111ebeeca7 req-2d4cc8a9-7ec4-46cd-9f05-76a29f70cc4a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0569441 Nov 12 14:56:16.963463 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10ca884f-e261-4846-9866-ef111ebeeca7 req-b1299652-babb-4e37-ad2b-1cbd2b83b0e3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454607 Nov 12 14:56:18.086716 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468bfd09-f5d4-40fd-b95a-132a524c60f3 req-1a93968e-514d-4479-9048-d5d8369ad22b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:18.088185 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-468bfd09-f5d4-40fd-b95a-132a524c60f3 req-1a93968e-514d-4479-9048-d5d8369ad22b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0485125 Nov 12 14:56:18.137894 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-468bfd09-f5d4-40fd-b95a-132a524c60f3 req-5298f0a5-ec94-4639-8396-bea7a1067f7a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438526 Nov 12 14:56:18.635754 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55608) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:18.681116 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-22b2b0cc-e0a8-4f46-9790-89d79e57851f admin admin] Deleting subnet dd2d4dae-b732-4123-90af-8645300420da {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 14:56:18.684472 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-22b2b0cc-e0a8-4f46-9790-89d79e57851f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:18.721027 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-22b2b0cc-e0a8-4f46-9790-89d79e57851f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:18.760280 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-22b2b0cc-e0a8-4f46-9790-89d79e57851f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:18.820172 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-22b2b0cc-e0a8-4f46-9790-89d79e57851f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:18.843130 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22b2b0cc-e0a8-4f46-9790-89d79e57851f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=dd2d4dae-b732-4123-90af-8645300420da,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:18.847369 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-22b2b0cc-e0a8-4f46-9790-89d79e57851f admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:18.850792 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-22b2b0cc-e0a8-4f46-9790-89d79e57851f admin admin] 10.222.0.61 "DELETE /v2.0/subnets/dd2d4dae-b732-4123-90af-8645300420da HTTP/1.1" status: 204 len: 168 time: 0.2139471 Nov 12 14:56:18.853585 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55614) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:18.920854 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.005854 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.026662 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c99d116e-3040-4028-8675-ad12dd87958d']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:19.036282 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '596317c1-3ea0-41df-b1b0-0fd9146ab825') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:19.036574 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '596317c1-3ea0-41df-b1b0-0fd9146ab825') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:19.045917 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.059213 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.065976 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] Releasing vlan 636 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 14:56:19.066358 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 14:56:19.068063 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 14:56:19.126969 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.134393 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.137641 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] 10.222.0.61 "DELETE /v2.0/networks/c99d116e-3040-4028-8675-ad12dd87958d HTTP/1.1" status: 204 len: 168 time: 0.2830100 Nov 12 14:56:19.316053 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55622) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:19.320987 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94dfb7fc-3364-4d5b-9f5a-1ce106ea2d7b admin admin] Pushing event deleted for resources: {'Network': ['ID=c99d116e-3040-4028-8675-ad12dd87958d,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:19.363797 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f893712c-b009-48b3-bc87-4deca0691071 req-eca2d587-5759-465c-a056-ede038f7db0f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:19.364054 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-376f3e90-589f-4bb2-b748-cecd617c1abb admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=c5cd628706954cf7a4c6ff4180751364&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0466273 Nov 12 14:56:19.365463 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f893712c-b009-48b3-bc87-4deca0691071 req-eca2d587-5759-465c-a056-ede038f7db0f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0533319 Nov 12 14:56:19.366279 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55624) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:19.443324 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f893712c-b009-48b3-bc87-4deca0691071 req-7488763a-f21a-4cd5-bc68-ad7ba80a8fd5 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710611 Nov 12 14:56:19.446232 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8eb5d6b1-72a8-4c85-91c1-56466e6c31a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.467707 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8eb5d6b1-72a8-4c85-91c1-56466e6c31a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.516764 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8eb5d6b1-72a8-4c85-91c1-56466e6c31a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.519463 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8eb5d6b1-72a8-4c85-91c1-56466e6c31a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:19.520628 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-8eb5d6b1-72a8-4c85-91c1-56466e6c31a8 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1d806b9c-55a2-4517-9ffc-a15fbecdc272 HTTP/1.1" status: 204 len: 168 time: 0.1534653 Nov 12 14:56:19.528904 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8eb5d6b1-72a8-4c85-91c1-56466e6c31a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1d806b9c-55a2-4517-9ffc-a15fbecdc272,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:20.237560 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55652) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:20.334292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-network', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:20.354361 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Made reservation on behalf of 296b2e6385f04550a366eb21cf48ea40 for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:56:20.356728 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.365162 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.440613 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.445017 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.473868 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 638} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:56:20.480029 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87f47fd6-882c-434a-96fe-da710aeafe5f,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:20.488604 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.488884 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Added segment d67bfce2-3a19-495f-a2aa-b7d951abcd01 of type vlan for network 368d9cfc-aec2-497f-8e69-e7fae7839a5a Nov 12 14:56:20.537011 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.564799 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.565857 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:20.566493 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.572880 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7dc0784-7ede-4e45-8915-6de5fbbbdcfe req-ce56bb65-be94-4269-8116-e74d1ef72e5e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:20.574993 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b7dc0784-7ede-4e45-8915-6de5fbbbdcfe req-ce56bb65-be94-4269-8116-e74d1ef72e5e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0556931 Nov 12 14:56:20.629534 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.3896716 Nov 12 14:56:20.630129 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b7dc0784-7ede-4e45-8915-6de5fbbbdcfe req-9157f02b-5126-4ae5-b926-b6029d57dcd0 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478413 Nov 12 14:56:20.631324 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55660) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:20.636036 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b50fec08-bb6d-4a62-821d-e2a9cacd2a5b admin admin] Pushing event updated for resources: {'Network': ['ID=368d9cfc-aec2-497f-8e69-e7fae7839a5a,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:20.638751 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Request body: {'subnet': {'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-subnet', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:20.650059 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:56:20.670486 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Made reservation on behalf of 296b2e6385f04550a366eb21cf48ea40 for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:56:20.672869 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5175757'] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.904913 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7428832', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5175775'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:20.964058 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Pushing event updated for resources: {'Subnet': ['ID=c422e2f7-99f1-47f1-a8bd-e908500e494f,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:20.983967 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Checking segment: {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:56:20.984860 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Network hostable DHCP agents. Network: 368d9cfc-aec2-497f-8e69-e7fae7839a5a, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:56:21.005238 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:56:21.015068 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 368d9cfc-aec2-497f-8e69-e7fae7839a5a) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:56:21.023946 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c95844ff-6351-4025-8e2f-08d4e945aafd None None] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:56:21.024221 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:21.024825 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.042032 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-2102706f-dbd4-4ed3-9067-aeb99a84b7ec admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.4096427 Nov 12 14:56:21.044937 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55668) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:21.050276 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:21.073331 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.074559 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.131231 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.189458 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 14:56:21.190313 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.273386 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.324792 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Allocated IP 172.20.0.2 (368d9cfc-aec2-497f-8e69-e7fae7839a5a/c422e2f7-99f1-47f1-a8bd-e908500e494f/537751a3-3099-489d-b7de-9cadf291dcab) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:56:21.481154 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.488168 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.489703 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.509236 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.528554 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:56:21.533890 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:56:21.541412 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:56:21.544480 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Pushing event updated for resources: {'Port': ['ID=537751a3-3099-489d-b7de-9cadf291dcab,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:21.556015 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.556406 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.556746 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.557075 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.557520 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.557881 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.558394 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.558749 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.559149 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.559465 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.563604 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.563604 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:21.610548 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Attempting to bind port 537751a3-3099-489d-b7de-9cadf291dcab on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:56:21.610548 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Attempting to bind port 537751a3-3099-489d-b7de-9cadf291dcab by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:56:21.610548 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Attempting to bind port 537751a3-3099-489d-b7de-9cadf291dcab on network 368d9cfc-aec2-497f-8e69-e7fae7839a5a {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:56:21.615316 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 55, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:56:21.615685 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Checking segment: {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:56:21.616078 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.616494 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Bound using segment: {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:56:21.616954 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Bound port: 537751a3-3099-489d-b7de-9cadf291dcab, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:56:21.617330 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.620739 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Allocated IP 172.27.3.41 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/838116c9-df39-42cd-af51-5ea055dc1510) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:56:21.685012 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] For port 537751a3-3099-489d-b7de-9cadf291dcab, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:56:21.689484 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] For port 537751a3-3099-489d-b7de-9cadf291dcab, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=537751a3-3099-489d-b7de-9cadf291dcab,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:56:21.700784 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.726402 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.784340 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:21.789647 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c337f4-bde8-4b36-b1ed-0e5aedd189ab None None] Pushing event updated for resources: {'Port': ['ID=537751a3-3099-489d-b7de-9cadf291dcab,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:21.842542 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:56:21.852994 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-704905af-8811-47fc-9bc3-2c4dc1f441c7 req-18bd662d-67e4-4b27-9873-4b7ff2989a90 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:21.854508 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-704905af-8811-47fc-9bc3-2c4dc1f441c7 req-18bd662d-67e4-4b27-9873-4b7ff2989a90 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1402817 Nov 12 14:56:21.857657 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:56:21.865306 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:56:21.898792 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Pushing event updated for resources: {'Port': ['ID=838116c9-df39-42cd-af51-5ea055dc1510,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:22.039374 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-704905af-8811-47fc-9bc3-2c4dc1f441c7 req-d9c29c35-7443-4928-9394-92f00cc9762f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1495984 Nov 12 14:56:22.111503 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1a70d4a2-4c21-4225-a0ae-3e4dafc9f90b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:22.256786 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:22.456126 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:22.591734 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Router 2b5b59a1-46c8-4703-94e6-adf835fba661 is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101617) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 14:56:22.669620 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 537751a3-3099-489d-b7de-9cadf291dcab up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:56:22.713844 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:56:22.724350 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 537751a3-3099-489d-b7de-9cadf291dcab triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:22.725687 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:22.726513 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Sync routers for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:56:22.734813 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] Publish callbacks [] for router, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:22.739041 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:56:22.739709 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-93ad69d4-aa09-455d-b001-1a3c7d1df25e admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 1.6936712 Nov 12 14:56:22.739880 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55696) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:22.748157 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:55:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:22.812829 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:22.853051 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port 537751a3-3099-489d-b7de-9cadf291dcab, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=537751a3-3099-489d-b7de-9cadf291dcab,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:56:22.858060 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:22.908782 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:56:22.928538 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=537751a3-3099-489d-b7de-9cadf291dcab,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:22.947541 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5e1bf48-07f6-4712-a0b9-52b26699f4f2 None None] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:56:23.063223 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-a1c0a9ef-f7e6-4cbf-93b2-79b207eb2666 None None] Provisioning complete for port 537751a3-3099-489d-b7de-9cadf291dcab triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:23.063597 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-a1c0a9ef-f7e6-4cbf-93b2-79b207eb2666 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.110165 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:22Z', 'revision_number': 3, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:23.138163 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Checking router: 2b5b59a1-46c8-4703-94e6-adf835fba661 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:56:23.138509 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Updating router 2b5b59a1-46c8-4703-94e6-adf835fba661 port 838116c9-df39-42cd-af51-5ea055dc1510 binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:56:23.167852 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.191916 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aceca5a-a727-4922-b125-b1c6751c956a req-485dc910-4b35-4ae7-9508-b2920fa01d0c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:23.194070 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5aceca5a-a727-4922-b125-b1c6751c956a req-485dc910-4b35-4ae7-9508-b2920fa01d0c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0560923 Nov 12 14:56:23.231639 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.261733 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5aceca5a-a727-4922-b125-b1c6751c956a req-a9e06b8b-6c5d-4cc0-9722-ce02d06f7a11 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621071 Nov 12 14:56:23.478112 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.484190 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.534394 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-51a564da-8d51-4bf5-8aa7-9914cd451c4b None None] Provisioning complete for port 537751a3-3099-489d-b7de-9cadf291dcab triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:23.535181 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-51a564da-8d51-4bf5-8aa7-9914cd451c4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.549040 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Pushing event updated for resources: {'Port': ['ID=838116c9-df39-42cd-af51-5ea055dc1510,revision_number=2']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:23.559383 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.559761 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.560133 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.560498 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.560833 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.561178 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.561519 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.561884 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.562275 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.562611 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.562974 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.563321 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:56:23.571696 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Attempting to bind port 838116c9-df39-42cd-af51-5ea055dc1510 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:56:23.573198 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Attempting to bind port 838116c9-df39-42cd-af51-5ea055dc1510 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:56:23.573198 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Attempting to bind port 838116c9-df39-42cd-af51-5ea055dc1510 on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:56:23.584413 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 55, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:56:23.585050 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:56:23.585554 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.586160 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:56:23.586863 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Bound port: 838116c9-df39-42cd-af51-5ea055dc1510, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:56:23.587572 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.642707 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] For port 838116c9-df39-42cd-af51-5ea055dc1510, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:56:23.646537 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] For port 838116c9-df39-42cd-af51-5ea055dc1510, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=838116c9-df39-42cd-af51-5ea055dc1510,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:56:23.659012 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Allocated IP 172.20.0.1 (368d9cfc-aec2-497f-8e69-e7fae7839a5a/c422e2f7-99f1-47f1-a8bd-e908500e494f/0833b1db-55ba-43fd-bd5e-04e8eec98b80) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:56:23.665427 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.732674 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:56:23.733373 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:55:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:23.781945 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4560280e-e7c5-4d5b-8994-67d8d6573896 None None] Pushing event updated for resources: {'Port': ['ID=838116c9-df39-42cd-af51-5ea055dc1510,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:23.787478 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.825154 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.852187 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:56:23.869062 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:56:23.873708 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:56:23.880470 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:56:23.880944 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:23.927560 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Pushing event updated for resources: {'Port': ['ID=0833b1db-55ba-43fd-bd5e-04e8eec98b80,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:24.042901 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:24.087492 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:22Z', 'revision_number': 3, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:24.126063 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97457e73-3cf6-449c-8862-d3ccbb00fb80 None None] The sync data for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi is: [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:22Z', 'revision_number': 3, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:56:24.191141 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-9f5cf18e-1076-45fe-92b1-cf582a24798a None None] Provisioning complete for port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:24.192219 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-9f5cf18e-1076-45fe-92b1-cf582a24798a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:24.236070 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-9f5cf18e-1076-45fe-92b1-cf582a24798a None None] Port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:56:24.242126 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:24.247411 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:24.248298 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:24.348474 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Pushing event updated for resources: {'Port': ['ID=0833b1db-55ba-43fd-bd5e-04e8eec98b80,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:24.418677 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:56:24.420222 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:56:24.426678 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626f4504-dfa9-4b5f-b40c-362483db8844 req-1b5649a0-1153-4c41-a65f-c7086bfe700e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:24.428291 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-626f4504-dfa9-4b5f-b40c-362483db8844 req-1b5649a0-1153-4c41-a65f-c7086bfe700e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0774515 Nov 12 14:56:24.517090 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e72d0071-1031-432b-97b2-ccae9b05bc93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:24.519348 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-626f4504-dfa9-4b5f-b40c-362483db8844 req-9fbcfd15-d799-4398-b418-796915176c96 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788846 Nov 12 14:56:24.587570 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Router 2b5b59a1-46c8-4703-94e6-adf835fba661 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 14:56:24.760783 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:56:24.766698 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-18544cf8-bf76-497e-a398-bf87d1a96c4b admin admin] 10.222.0.61 "PUT /v2.0/routers/2b5b59a1-46c8-4703-94e6-adf835fba661/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0254438 Nov 12 14:56:24.789568 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 838116c9-df39-42cd-af51-5ea055dc1510 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:56:24.818570 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-eaa268fe-c3ab-475c-9793-e21e1a4e1582 None None] Provisioning complete for port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:24.818954 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-eaa268fe-c3ab-475c-9793-e21e1a4e1582 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:24.869491 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-eaa268fe-c3ab-475c-9793-e21e1a4e1582 None None] Port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:56:24.887105 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 838116c9-df39-42cd-af51-5ea055dc1510 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:24.887559 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:24.994913 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.020207 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port 838116c9-df39-42cd-af51-5ea055dc1510, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=838116c9-df39-42cd-af51-5ea055dc1510,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:56:25.025579 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.026540 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 537751a3-3099-489d-b7de-9cadf291dcab up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:56:25.114560 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=838116c9-df39-42cd-af51-5ea055dc1510,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:25.129028 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 537751a3-3099-489d-b7de-9cadf291dcab triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:25.129622 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.372147 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55732) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:25.378102 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-75498765-4278-4c8f-b697-859aeb3cfd20 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2052511323', 'description': 'tempest-description--144197693'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:25.405329 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-75498765-4278-4c8f-b697-859aeb3cfd20 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.493305 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-75498765-4278-4c8f-b697-859aeb3cfd20 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.497875 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-75498765-4278-4c8f-b697-859aeb3cfd20 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.510601 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.525519 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-75498765-4278-4c8f-b697-859aeb3cfd20 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.527238 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-75498765-4278-4c8f-b697-859aeb3cfd20 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1548421 Nov 12 14:56:25.529918 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55734) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:25.537797 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75498765-4278-4c8f-b697-859aeb3cfd20 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'SecurityGroup': ['ID=35291230-5c54-46fa-a3c4-6ead2197bb81,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:25.546754 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-69113824-ad6c-459f-a096-5c569cadd593 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'security_group_rule': {'security_group_id': '35291230-5c54-46fa-a3c4-6ead2197bb81', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:25.582769 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-69113824-ad6c-459f-a096-5c569cadd593 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.673080 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aba03d72-82fd-4b7d-bab9-b19d1041178e req-c4da8508-fa26-41da-afff-f1d30d5c8a15 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:25.674649 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aba03d72-82fd-4b7d-bab9-b19d1041178e req-c4da8508-fa26-41da-afff-f1d30d5c8a15 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0757356 Nov 12 14:56:25.676633 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-69113824-ad6c-459f-a096-5c569cadd593 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.681464 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-69113824-ad6c-459f-a096-5c569cadd593 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.723810 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69113824-ad6c-459f-a096-5c569cadd593 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ecf65141-fe2c-42cf-8f3e-940e255963ed,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:25.743253 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-69113824-ad6c-459f-a096-5c569cadd593 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.744583 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-69113824-ad6c-459f-a096-5c569cadd593 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2134256 Nov 12 14:56:25.750301 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55742) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:25.767416 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-aec934b5-cda4-4ea5-9fa5-a1e903fc4299 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'security_group_rule': {'security_group_id': '35291230-5c54-46fa-a3c4-6ead2197bb81', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:25.791605 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aba03d72-82fd-4b7d-bab9-b19d1041178e req-8c1f5dab-85c0-4cfc-a69f-e74c857fd9b9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1045799 Nov 12 14:56:25.817493 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-aec934b5-cda4-4ea5-9fa5-a1e903fc4299 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.915420 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-aec934b5-cda4-4ea5-9fa5-a1e903fc4299 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.920745 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-aec934b5-cda4-4ea5-9fa5-a1e903fc4299 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.949805 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aec934b5-cda4-4ea5-9fa5-a1e903fc4299 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=06a174fd-71bc-4d05-a58a-8a32930a62ee,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:25.965237 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Sync routers for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:56:25.967078 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-aec934b5-cda4-4ea5-9fa5-a1e903fc4299 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:25.969474 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-aec934b5-cda4-4ea5-9fa5-a1e903fc4299 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2156417 Nov 12 14:56:25.972570 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55748) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:25.981268 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'floatingip': {'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:25.993098 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:56:25.993995 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:56:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:26.026499 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:26.177623 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:56:26.238455 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:26.433658 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Allocated IP 172.27.3.238 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/bb414147-ff56-447b-9c91-0bce695f060e) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:56:26.641542 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 2, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:26.689421 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Checking router: 2b5b59a1-46c8-4703-94e6-adf835fba661 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:56:26.690015 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Updating router 2b5b59a1-46c8-4703-94e6-adf835fba661 port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:56:26.721796 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:26.724960 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 838116c9-df39-42cd-af51-5ea055dc1510 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:56:26.775861 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:26.786890 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:26.840612 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:56:26.846885 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:56:26.851077 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:56:26.862657 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'Port': ['ID=bb414147-ff56-447b-9c91-0bce695f060e,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:26.928471 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:26.929881 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 838116c9-df39-42cd-af51-5ea055dc1510 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:26.930322 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:26.967036 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:26.992311 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.078253 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee03483-4692-41cf-aea9-fb450bf3e2f9 req-014b0e2c-b099-4ccf-b2f7-a5136929ddb1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:27.080141 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fee03483-4692-41cf-aea9-fb450bf3e2f9 req-014b0e2c-b099-4ccf-b2f7-a5136929ddb1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1084051 Nov 12 14:56:27.203385 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fee03483-4692-41cf-aea9-fb450bf3e2f9 req-f5fb5d01-720c-4d53-89a6-a3130ee842bf tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1092317 Nov 12 14:56:27.204807 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.211556 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.289444 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.297550 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.301027 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75eaac71-9de2-4d9c-9b91-320e8a95b7bd None None] Pushing event updated for resources: {'Port': ['ID=0833b1db-55ba-43fd-bd5e-04e8eec98b80,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:27.343891 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Attempting to bind port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:56:27.344203 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Attempting to bind port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:56:27.344567 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Attempting to bind port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 on network 368d9cfc-aec2-497f-8e69-e7fae7839a5a {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:56:27.352198 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 55, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:56:27.352543 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Checking segment: {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:56:27.352835 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.357344 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Bound using segment: {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:56:27.357344 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Bound port: 0833b1db-55ba-43fd-bd5e-04e8eec98b80, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:56:27.357344 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.361973 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.398179 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'Port': ['ID=bb414147-ff56-447b-9c91-0bce695f060e,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:27.412813 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.414950 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-8f11b351-c1d3-4245-bef9-df99123078a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.4406796 Nov 12 14:56:27.499374 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] For port 0833b1db-55ba-43fd-bd5e-04e8eec98b80, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:56:27.509352 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] For port 0833b1db-55ba-43fd-bd5e-04e8eec98b80, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=0833b1db-55ba-43fd-bd5e-04e8eec98b80,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:56:27.521171 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.567975 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-f81b4d46-b9e6-4065-b178-fcbfc359d3f5 None None] Provisioning complete for port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:27.575807 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f81b4d46-b9e6-4065-b178-fcbfc359d3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.618344 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55792) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:27.632637 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:56:27.633799 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:56:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:27.694069 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75eaac71-9de2-4d9c-9b91-320e8a95b7bd None None] Pushing event updated for resources: {'Port': ['ID=0833b1db-55ba-43fd-bd5e-04e8eec98b80,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:27.886032 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:56:27.926624 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-450bd6a0-de56-4186-ac71-cfcb62e11119 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.939511 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f81b4d46-b9e6-4065-b178-fcbfc359d3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:27.972510 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.058588 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-381db0ff-7122-4df9-8106-a03c51783872 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-securitygroup--2052511323&fields=id&tenant_id=296b2e6385f04550a366eb21cf48ea40 HTTP/1.1" status: 200 len: 267 time: 0.4853714 Nov 12 14:56:28.061083 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-f81b4d46-b9e6-4065-b178-fcbfc359d3f5 None None] For port 0833b1db-55ba-43fd-bd5e-04e8eec98b80, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=0833b1db-55ba-43fd-bd5e-04e8eec98b80,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:56:28.100651 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f81b4d46-b9e6-4065-b178-fcbfc359d3f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.140762 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-450bd6a0-de56-4186-ac71-cfcb62e11119 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.151283 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-450bd6a0-de56-4186-ac71-cfcb62e11119 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.200623 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450bd6a0-de56-4186-ac71-cfcb62e11119 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dff24409-e09a-41f1-9cf3-e1d59c89d98a,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:28.211052 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c5b530-81e8-4239-92df-640a59d744db req-c8092037-5346-4acf-b951-73df51c2a28c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:28.219088 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-c8092037-5346-4acf-b951-73df51c2a28c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 817 time: 0.1514463 Nov 12 14:56:28.236392 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-450bd6a0-de56-4186-ac71-cfcb62e11119 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=ab717f246db246dda9724195caae3a55&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6167872 Nov 12 14:56:28.241740 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-6fe086ef-d94b-4d30-8783-93b126e01a52 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/quotas/296b2e6385f04550a366eb21cf48ea40 HTTP/1.1" status: 200 len: 375 time: 0.0211029 Nov 12 14:56:28.242515 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55814) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:28.308847 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f81b4d46-b9e6-4065-b178-fcbfc359d3f5 None None] Pushing event updated for resources: {'Port': ['ID=0833b1db-55ba-43fd-bd5e-04e8eec98b80,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:28.329115 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-9f3be489-c325-4585-8377-f35852dbd0f8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0861745 Nov 12 14:56:28.341072 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-2fa6e6a6-d4a3-4fb5-8ed0-0f963f924b26 None None] Provisioning complete for port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:28.341590 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2fa6e6a6-d4a3-4fb5-8ed0-0f963f924b26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.342401 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9fd8fabb-7206-4cf1-b3c6-d12004c18225 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.426068 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9fd8fabb-7206-4cf1-b3c6-d12004c18225 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.433616 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55818) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:28.456795 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-29dc2007-41cb-4d2c-8cba-3d51faa0e5d1 service neutron] 10.222.0.61 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1225214 Nov 12 14:56:28.492535 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ec21c6c-a0b4-4992-a167-9320377174e7 req-cb385610-f0cc-4111-8317-7ff1ef518a50 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:28.505366 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8ec21c6c-a0b4-4992-a167-9320377174e7 req-cb385610-f0cc-4111-8317-7ff1ef518a50 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1308038 Nov 12 14:56:28.588418 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8ec21c6c-a0b4-4992-a167-9320377174e7 req-5ef8a1bd-b98d-422e-89a3-acf5d3be4ced tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701904 Nov 12 14:56:28.614788 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fd2c346-cec8-4100-b694-5ecaed2a066d admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.615251 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9fd8fabb-7206-4cf1-b3c6-d12004c18225 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.618106 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9fd8fabb-7206-4cf1-b3c6-d12004c18225 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.621255 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-9fd8fabb-7206-4cf1-b3c6-d12004c18225 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/dff24409-e09a-41f1-9cf3-e1d59c89d98a HTTP/1.1" status: 204 len: 168 time: 0.3771725 Nov 12 14:56:28.632999 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fd8fabb-7206-4cf1-b3c6-d12004c18225 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dff24409-e09a-41f1-9cf3-e1d59c89d98a,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:28.708864 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-b55b35be-9a4a-48a1-b290-122e4a09b4c5 service neutron] 10.222.0.61 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2467253 Nov 12 14:56:28.709006 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:28.745099 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3a606265-6f52-4a3c-b603-3e77f9b498e2 None None] The sync data for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi is: [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:56:28.784320 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fd2c346-cec8-4100-b694-5ecaed2a066d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.790418 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6fd2c346-cec8-4100-b694-5ecaed2a066d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:28.881822 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6fd2c346-cec8-4100-b694-5ecaed2a066d admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e2fa714e851e4b11b958aecd5cde39a5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4470985 Nov 12 14:56:28.885883 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55826) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:28.889429 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd2c346-cec8-4100-b694-5ecaed2a066d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=abecb0d2-d17a-4cc7-9fb4-1fc0640d4403,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:29.025926 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0b604027-176d-4722-8f86-35d6996516b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:29.073395 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0b604027-176d-4722-8f86-35d6996516b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:29.157153 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b7301126-0c7b-40c3-b377-abde8c455ccb req-b976d6f0-8cce-4f08-be6b-1d03a34a454c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.1086369 Nov 12 14:56:29.202236 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0b604027-176d-4722-8f86-35d6996516b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:29.206288 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0b604027-176d-4722-8f86-35d6996516b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:29.207708 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-0b604027-176d-4722-8f86-35d6996516b0 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/abecb0d2-d17a-4cc7-9fb4-1fc0640d4403 HTTP/1.1" status: 204 len: 168 time: 0.3203998 Nov 12 14:56:29.238146 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b604027-176d-4722-8f86-35d6996516b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abecb0d2-d17a-4cc7-9fb4-1fc0640d4403,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:29.759527 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb173707-15c3-4bcd-a7dc-519acc341f20 req-324fd351-e57a-4138-a232-c9d5dc1ad2d8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:29.770526 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fb173707-15c3-4bcd-a7dc-519acc341f20 req-324fd351-e57a-4138-a232-c9d5dc1ad2d8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0715044 Nov 12 14:56:29.845525 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fb173707-15c3-4bcd-a7dc-519acc341f20 req-7b0afea1-fd42-4d7d-92de-ecf19a1ee7ea tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738831 Nov 12 14:56:29.868285 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 55874) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:29.885186 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07ab1a70-857b-4d14-8d89-441c1f19cb3d admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:30.013622 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07ab1a70-857b-4d14-8d89-441c1f19cb3d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:30.024363 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07ab1a70-857b-4d14-8d89-441c1f19cb3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:30.130726 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-07ab1a70-857b-4d14-8d89-441c1f19cb3d admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=ead50063d0f3472ca37549cd67f65252&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2609603 Nov 12 14:56:30.133648 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ab1a70-857b-4d14-8d89-441c1f19cb3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f508d81e-3ff6-49ee-9125-b70cbe5b4c67,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:30.134549 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55884) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:30.247574 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ee965e19-751e-4c51-bc83-72994450d60a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:30.301776 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3cd1f2ad-8227-4b30-85b1-ca7138354b9e req-0bf5f082-55ee-4031-b580-cdb85f0eaed6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0368257 Nov 12 14:56:30.307516 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ee965e19-751e-4c51-bc83-72994450d60a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:30.373002 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ee965e19-751e-4c51-bc83-72994450d60a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:30.376795 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ee965e19-751e-4c51-bc83-72994450d60a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:30.381048 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-ee965e19-751e-4c51-bc83-72994450d60a admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f508d81e-3ff6-49ee-9125-b70cbe5b4c67 HTTP/1.1" status: 204 len: 168 time: 0.2453547 Nov 12 14:56:30.398224 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee965e19-751e-4c51-bc83-72994450d60a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f508d81e-3ff6-49ee-9125-b70cbe5b4c67,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:30.759239 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0833b1db-55ba-43fd-bd5e-04e8eec98b80 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:56:30.944710 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:30.945887 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:30.982927 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c5b530-81e8-4239-92df-640a59d744db req-fcb223db-3050-43cc-a611-a67831fcde8a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:30.988311 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-fcb223db-3050-43cc-a611-a67831fcde8a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 817 time: 0.4386606 Nov 12 14:56:31.092741 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05e5579a-6fe5-476c-9537-19a8998aca74 req-435698be-ebd6-422d-9214-83b95fe14844 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:31.101029 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-05e5579a-6fe5-476c-9537-19a8998aca74 req-435698be-ebd6-422d-9214-83b95fe14844 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1109433 Nov 12 14:56:31.147361 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-da59d9e1-8bd1-433d-890e-80bb15d3d665 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=296b2e6385f04550a366eb21cf48ea40 HTTP/1.1" status: 200 len: 380 time: 0.1460214 Nov 12 14:56:31.180176 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'port': {'device_id': '82360b9e-d05e-4010-8b74-d862c5e66562', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'admin_state_up': True, 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'security_groups': ['35291230-5c54-46fa-a3c4-6ead2197bb81']}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:31.262485 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-05e5579a-6fe5-476c-9537-19a8998aca74 req-b35644f1-d0ed-4a87-89c0-72a4b7b20a2b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1519868 Nov 12 14:56:31.382108 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Made reservation on behalf of 296b2e6385f04550a366eb21cf48ea40 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:56:31.390946 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:31.610439 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3553c398-1ef9-45a8-bf72-edd86251102a req-36e984ab-56a9-439d-8574-760afee6c0b4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0868418 Nov 12 14:56:31.634654 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 55986) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:31.691819 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Allocated IP 172.20.0.3 (368d9cfc-aec2-497f-8e69-e7fae7839a5a/c422e2f7-99f1-47f1-a8bd-e908500e494f/d2b7f476-dd48-4efe-b149-aad19da5171f) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:56:31.807775 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a91b815d-3693-416f-89fb-4542d550a19f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:31.904815 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:31.909811 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a91b815d-3693-416f-89fb-4542d550a19f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:31.918160 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a91b815d-3693-416f-89fb-4542d550a19f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:31.951487 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:31.981193 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-a91b815d-3693-416f-89fb-4542d550a19f admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=ab8d027948c74edda16ebe99e3750730&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3454309 Nov 12 14:56:31.982322 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a91b815d-3693-416f-89fb-4542d550a19f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e3d60de-9c2b-494c-bb57-26dd8c99b023,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:31.985552 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 56000) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:32.036390 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:56:32.040013 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:56:32.053036 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:56:32.060292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:32.060889 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:32.070031 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3eb10dc6-032b-4fae-a8bb-98fd7b145f55 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:32.076489 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:32.091214 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-de960533-f9d6-46ac-8abb-9bf7a6c986e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9345286 Nov 12 14:56:32.105977 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Request body: {'port': {'device_id': '82360b9e-d05e-4010-8b74-d862c5e66562', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:32.139572 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3eb10dc6-032b-4fae-a8bb-98fd7b145f55 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:32.198311 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:32.230777 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3eb10dc6-032b-4fae-a8bb-98fd7b145f55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:32.235511 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3eb10dc6-032b-4fae-a8bb-98fd7b145f55 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:32.251562 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-3eb10dc6-032b-4fae-a8bb-98fd7b145f55 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/7e3d60de-9c2b-494c-bb57-26dd8c99b023 HTTP/1.1" status: 204 len: 168 time: 0.2534077 Nov 12 14:56:32.284840 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eb10dc6-032b-4fae-a8bb-98fd7b145f55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e3d60de-9c2b-494c-bb57-26dd8c99b023,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:32.502964 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-07f249ed-f6ea-4473-a46e-757cffd4ca54 None None] Provisioning complete for port d2b7f476-dd48-4efe-b149-aad19da5171f triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:32.503706 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-07f249ed-f6ea-4473-a46e-757cffd4ca54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:32.553821 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-07f249ed-f6ea-4473-a46e-757cffd4ca54 None None] Port d2b7f476-dd48-4efe-b149-aad19da5171f cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:56:32.597724 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ccd835b-9dce-449f-a61c-c1670d4b3682 req-82be7156-8762-47bd-8f1f-91fc59690b13 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:32.597724 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1ccd835b-9dce-449f-a61c-c1670d4b3682 req-82be7156-8762-47bd-8f1f-91fc59690b13 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1353397 Nov 12 14:56:32.685146 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1ccd835b-9dce-449f-a61c-c1670d4b3682 req-a3e67878-dd7d-4d1c-8cd3-ba5ca8efd4ed tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848770 Nov 12 14:56:32.807620 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d2b7f476-dd48-4efe-b149-aad19da5171f {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:56:32.819241 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:32.824342 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f22f948-ff7a-4bb8-b5d8-0640b0d69202 req-e975af1d-6ed4-4484-afe1-24347a0af46d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:32.826862 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9f22f948-ff7a-4bb8-b5d8-0640b0d69202 req-e975af1d-6ed4-4484-afe1-24347a0af46d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 931 time: 0.0789459 Nov 12 14:56:32.839999 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Transition to ACTIVE for port object d2b7f476-dd48-4efe-b149-aad19da5171f will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:56:32.855317 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:32.901405 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9f22f948-ff7a-4bb8-b5d8-0640b0d69202 req-4520ad70-9943-43af-aae4-39937d100bf3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0658247 Nov 12 14:56:32.947635 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:32.963646 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Attempting to bind port d2b7f476-dd48-4efe-b149-aad19da5171f on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:56:32.963847 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Attempting to bind port d2b7f476-dd48-4efe-b149-aad19da5171f by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:56:32.964195 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Attempting to bind port d2b7f476-dd48-4efe-b149-aad19da5171f on network 368d9cfc-aec2-497f-8e69-e7fae7839a5a {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:56:32.969626 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Port d2b7f476-dd48-4efe-b149-aad19da5171f on network 368d9cfc-aec2-497f-8e69-e7fae7839a5a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:56:32.970029 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Attempting to bind port d2b7f476-dd48-4efe-b149-aad19da5171f on network 368d9cfc-aec2-497f-8e69-e7fae7839a5a {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:56:32.975183 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 56, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:56:32.975503 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Checking segment: {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:56:32.975875 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Bound using segment: {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:56:32.976466 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Bound port: d2b7f476-dd48-4efe-b149-aad19da5171f, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:56:32.976817 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:33.054281 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:56:33.058116 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:56:33.063888 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:33.126793 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:33.127407 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:33.129023 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] 10.222.0.86 "PUT /v2.0/ports/d2b7f476-dd48-4efe-b149-aad19da5171f HTTP/1.1" status: 200 len: 1093 time: 1.0288198 Nov 12 14:56:33.129350 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:56:33.131692 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c04a699-c4d9-44cc-9bde-db202ed914ba" -d '{"events": [{"name": "network-changed", "server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:56:33.174253 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f88c362-9e54-4f1e-8aed-c0a69fa06b68 service neutron] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:33.221118 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:56:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82a333cd-9395-4191-be41-c4b544a742c4 x-openstack-request-id: req-82a333cd-9395-4191-be41-c4b544a742c4 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:56:33.221830 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:56:33.221830 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-82a333cd-9395-4191-be41-c4b544a742c4 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:56:33.222211 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'status': 'completed', 'code': 200} Nov 12 14:56:33.274375 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c5b530-81e8-4239-92df-640a59d744db req-587ce6d3-bf73-4a82-8a58-513eadd007fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:33.276171 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-587ce6d3-bf73-4a82-8a58-513eadd007fa service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 1096 time: 0.0713859 Nov 12 14:56:33.357349 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-a2692a8f-e10e-4834-818e-e9b5266ecc84 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d2b7f476-dd48-4efe-b149-aad19da5171f HTTP/1.1" status: 200 len: 217 time: 0.0562029 Nov 12 14:56:33.430178 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c5b530-81e8-4239-92df-640a59d744db req-ea1cf8d4-094c-487d-8715-2d252ee97931 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:33.431666 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-ea1cf8d4-094c-487d-8715-2d252ee97931 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0644624 Nov 12 14:56:33.495176 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c5b530-81e8-4239-92df-640a59d744db req-9b74ce13-8dd4-43ab-84e3-15617af6401d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:33.504370 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-9b74ce13-8dd4-43ab-84e3-15617af6401d service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0487132 Nov 12 14:56:33.599716 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-72ebda28-a4a2-4855-a94a-624f4e07ecc6 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0936844 Nov 12 14:56:33.733779 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e3c5b530-81e8-4239-92df-640a59d744db req-e400446e-7338-4bfc-9881-7d81bfd5060a service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1200686 Nov 12 14:56:33.904382 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47cab31e-109a-4443-a5ff-1921e4d8bb50 req-171cf892-7fa8-4d13-b827-acf118d148c2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:33.925378 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-47cab31e-109a-4443-a5ff-1921e4d8bb50 req-171cf892-7fa8-4d13-b827-acf118d148c2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1166859 Nov 12 14:56:33.927321 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-c3781dd7-39c6-408c-bf18-85d1fe62c565 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:33.932775 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-c3781dd7-39c6-408c-bf18-85d1fe62c565 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 1096 time: 0.1146903 Nov 12 14:56:33.997658 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-47cab31e-109a-4443-a5ff-1921e4d8bb50 req-2d8c9c91-9e64-4a10-a357-62b443bd0b97 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695851 Nov 12 14:56:34.309270 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-6b511bb6-f9a1-46cd-8aed-e2001f9c3951 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:34.310713 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-6b511bb6-f9a1-46cd-8aed-e2001f9c3951 service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.3680677 Nov 12 14:56:34.319572 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c3bf65-3117-48ac-9f2f-9864c2ce6b1a req-f5246d62-a6b8-47f4-abcf-dc4cbea7d9b2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:34.320937 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-03c3bf65-3117-48ac-9f2f-9864c2ce6b1a req-f5246d62-a6b8-47f4-abcf-dc4cbea7d9b2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0730665 Nov 12 14:56:34.335793 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:56:34.368543 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-18f32ce9-c833-450e-ae8b-ff5df27f1498 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d2b7f476-dd48-4efe-b149-aad19da5171f HTTP/1.1" status: 200 len: 217 time: 0.0464935 Nov 12 14:56:34.429483 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-03c3bf65-3117-48ac-9f2f-9864c2ce6b1a req-a80fdeb6-2a6c-4bac-8b00-42c78279ada7 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1019907 Nov 12 14:56:34.442999 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-db6f291b-af82-4071-ace5-c14105e69616 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:34.444466 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-db6f291b-af82-4071-ace5-c14105e69616 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0632455 Nov 12 14:56:34.494231 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-361d92b7-da50-4d71-a336-243c0d18e51c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:34.495886 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-361d92b7-da50-4d71-a336-243c0d18e51c service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0406618 Nov 12 14:56:34.595552 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-638dfce1-464f-4286-98cb-66b4843d737a service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885634 Nov 12 14:56:34.695137 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6c04a699-c4d9-44cc-9bde-db202ed914ba req-b456b13d-7c45-4cfa-aed8-c4a33df17bbf service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882769 Nov 12 14:56:34.931837 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:35.154647 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8bfe226-c13e-43ce-823f-2759204e1f5b req-92f836f1-4e9f-4dae-af9e-448d9ccf9a19 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:35.156772 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b8bfe226-c13e-43ce-823f-2759204e1f5b req-92f836f1-4e9f-4dae-af9e-448d9ccf9a19 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0550904 Nov 12 14:56:35.216590 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b8bfe226-c13e-43ce-823f-2759204e1f5b req-354ec96e-135d-449e-b947-befcd46fc9a6 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529850 Nov 12 14:56:35.563143 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05a7b125-266d-4b96-a4e0-0358832340f8 req-246fa0db-4d83-4d78-97fe-19e5caef11c1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:35.567058 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-05a7b125-266d-4b96-a4e0-0358832340f8 req-246fa0db-4d83-4d78-97fe-19e5caef11c1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0525146 Nov 12 14:56:35.617333 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-05a7b125-266d-4b96-a4e0-0358832340f8 req-bfbd3c3b-61ba-4eba-9daa-2fe5a449e277 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457342 Nov 12 14:56:36.334596 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ee4010-0c20-492e-9dab-e8555cbd1724 req-577251e2-ac10-4c89-9760-147e49ffa19f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:36.336232 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-11ee4010-0c20-492e-9dab-e8555cbd1724 req-577251e2-ac10-4c89-9760-147e49ffa19f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0506117 Nov 12 14:56:36.384424 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-11ee4010-0c20-492e-9dab-e8555cbd1724 req-3005c8d0-d22b-4080-96b5-7c2411b80ef1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420556 Nov 12 14:56:36.401780 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 56116) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:36.507808 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0aafa716-7aea-456b-8e2c-28579b987b88 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:36.586864 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0aafa716-7aea-456b-8e2c-28579b987b88 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:36.592189 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-0aafa716-7aea-456b-8e2c-28579b987b88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:36.635964 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-0aafa716-7aea-456b-8e2c-28579b987b88 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=45900a248fb04843be868d5eae11d678&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2308495 Nov 12 14:56:36.635964 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aafa716-7aea-456b-8e2c-28579b987b88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe03e4fc-a60f-46e9-b757-ff758e08c6b2,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:36.643121 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 56122) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:36.722267 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fe1594bc-abf2-478e-a26e-5d1010ba55fd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:36.753777 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fe1594bc-abf2-478e-a26e-5d1010ba55fd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:36.779319 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5946c81-ac5e-4090-960b-4680acf8bcf0 req-d0c6b897-8ceb-4af8-b033-125909142389 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:36.780993 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b5946c81-ac5e-4090-960b-4680acf8bcf0 req-d0c6b897-8ceb-4af8-b033-125909142389 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0895829 Nov 12 14:56:36.855233 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b5946c81-ac5e-4090-960b-4680acf8bcf0 req-cd9e5689-9350-4325-af95-5c6ee11f3d02 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670116 Nov 12 14:56:36.861629 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fe1594bc-abf2-478e-a26e-5d1010ba55fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:36.864883 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fe1594bc-abf2-478e-a26e-5d1010ba55fd admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:36.866037 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-fe1594bc-abf2-478e-a26e-5d1010ba55fd admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/fe03e4fc-a60f-46e9-b757-ff758e08c6b2 HTTP/1.1" status: 204 len: 168 time: 0.2224293 Nov 12 14:56:36.875012 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe1594bc-abf2-478e-a26e-5d1010ba55fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe03e4fc-a60f-46e9-b757-ff758e08c6b2,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:37.154808 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 56132) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:37.169419 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-635f4a60-9996-46f3-b4bb-0300d13c389c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:37.248569 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-635f4a60-9996-46f3-b4bb-0300d13c389c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:37.253022 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-635f4a60-9996-46f3-b4bb-0300d13c389c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:37.292465 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635f4a60-9996-46f3-b4bb-0300d13c389c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62ab4565-97be-452c-be33-b5cf06a3282f,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:37.297636 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-635f4a60-9996-46f3-b4bb-0300d13c389c admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=9cf2dc92967144c1acfa42a6e0339154&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1411211 Nov 12 14:56:37.300491 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 56136) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:37.354863 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8a3869e2-938b-4a36-a124-296812237217 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:37.375252 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8a3869e2-938b-4a36-a124-296812237217 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:37.423288 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8a3869e2-938b-4a36-a124-296812237217 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:37.426047 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8a3869e2-938b-4a36-a124-296812237217 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:37.427264 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-8a3869e2-938b-4a36-a124-296812237217 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/62ab4565-97be-452c-be33-b5cf06a3282f HTTP/1.1" status: 204 len: 168 time: 0.1258030 Nov 12 14:56:37.437181 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a3869e2-938b-4a36-a124-296812237217 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62ab4565-97be-452c-be33-b5cf06a3282f,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:37.515998 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb9ec5fb-f0de-421f-a5df-216e80e981fc req-ce5f3b55-8e3f-4e6c-9427-ec2854104bbe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:37.517902 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fb9ec5fb-f0de-421f-a5df-216e80e981fc req-ce5f3b55-8e3f-4e6c-9427-ec2854104bbe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0516481 Nov 12 14:56:37.527825 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d2b7f476-dd48-4efe-b149-aad19da5171f details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:56:37.587991 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fb9ec5fb-f0de-421f-a5df-216e80e981fc req-3f76e780-f84f-41cc-a4f7-4cf0c65a0b4b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617936 Nov 12 14:56:37.638274 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:56:37.652289 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'port_id': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'mac_address': 'fa:16:3e:67:8f:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 638, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:56:37.696426 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:37.710518 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d2b7f476-dd48-4efe-b149-aad19da5171f {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:56:37.731220 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:56:37.735888 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:37.790211 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:38.002331 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f35a6732-b54e-42b0-aa37-35b2d3572f7e req-e01797b9-a1ed-4bd7-9885-9ebaecd68038 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:38.004071 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f35a6732-b54e-42b0-aa37-35b2d3572f7e req-e01797b9-a1ed-4bd7-9885-9ebaecd68038 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 944 time: 0.0551853 Nov 12 14:56:38.062493 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f35a6732-b54e-42b0-aa37-35b2d3572f7e req-0bc94da8-eee1-4c86-9121-f95f56243563 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520742 Nov 12 14:56:38.217563 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 56166) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:38.316911 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1715725465-network', 'tenant_id': '541f7684cc1c484fb8cde1d45d8b538e'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:38.339553 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Made reservation on behalf of 541f7684cc1c484fb8cde1d45d8b538e for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:56:38.342101 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.351049 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.431213 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.435604 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.462800 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 601} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:56:38.472770 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4fdb723-2bdc-45bd-81eb-e565bc5a9095,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:38.478902 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.479364 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Added segment 3e64eb13-260c-404a-8e4f-19728a3fbcf8 of type vlan for network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 Nov 12 14:56:38.526765 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.554831 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.555868 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:38.556476 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.589917 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3711112 Nov 12 14:56:38.593079 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 56172) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:38.598114 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Request body: {'subnet': {'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1715725465-subnet', 'tenant_id': '541f7684cc1c484fb8cde1d45d8b538e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:38.622009 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Made reservation on behalf of 541f7684cc1c484fb8cde1d45d8b538e for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:56:38.623885 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f1b69e7-a802-455e-bc41-26b8e97d7dd0 admin admin] Pushing event updated for resources: {'Network': ['ID=6ec68ee4-86ea-4750-8c5b-ad6204b38664,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:38.625109 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5175757'] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.636809 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:56:38.771175 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb39062b-b5e4-42ef-bc56-9bec7f04a6c7 req-27e13d4e-0497-4ba8-94fe-0fc8b6490780 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:38.772692 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cb39062b-b5e4-42ef-bc56-9bec7f04a6c7 req-27e13d4e-0497-4ba8-94fe-0fc8b6490780 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0883853 Nov 12 14:56:38.885856 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cb39062b-b5e4-42ef-bc56-9bec7f04a6c7 req-106c3b61-cd53-46cb-8704-75047d568cc4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1022515 Nov 12 14:56:38.906523 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7428832', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5175775'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:38.960771 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Pushing event updated for resources: {'Subnet': ['ID=91f83bd1-9576-4d8f-9a67-268c7bf31499,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:38.972306 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Checking segment: {'id': '3e64eb13-260c-404a-8e4f-19728a3fbcf8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:56:38.972665 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Network hostable DHCP agents. Network: 6ec68ee4-86ea-4750-8c5b-ad6204b38664, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:56:38.976032 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['d2b7f476-dd48-4efe-b149-aad19da5171f'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:56:39.011032 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:56:39.022965 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 6ec68ee4-86ea-4750-8c5b-ad6204b38664) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:56:39.032435 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4228871d-f25a-4bde-9121-6c45d987e03b None None] Network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:56:39.035496 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:39.036091 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:39.064698 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-10958a40-5b37-4c53-b5f4-87e7aa22873c admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4619272 Nov 12 14:56:39.224421 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-889d3c1b-587f-4d7b-b9af-22efd7c9a4c6 req-50cea76a-19df-4bc9-8af4-0b2edbe468f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:39.226419 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-889d3c1b-587f-4d7b-b9af-22efd7c9a4c6 req-50cea76a-19df-4bc9-8af4-0b2edbe468f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 944 time: 0.0609806 Nov 12 14:56:39.272895 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3db631fa-b790-4fcb-8478-6bfb97960505 None None] Network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:56:39.295276 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-889d3c1b-587f-4d7b-b9af-22efd7c9a4c6 req-04d88d95-7c8b-4bc6-829e-9acfa0475a74 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0548143 Nov 12 14:56:40.014827 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7fe31c-274f-4a69-99b1-d89bc39214ea req-da983788-bf9f-47d6-8138-bf8b66aafa81 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:40.016351 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1a7fe31c-274f-4a69-99b1-d89bc39214ea req-da983788-bf9f-47d6-8138-bf8b66aafa81 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0607681 Nov 12 14:56:40.066820 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1a7fe31c-274f-4a69-99b1-d89bc39214ea req-04b83240-ece9-4ff7-96b2-3316175a2c11 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443039 Nov 12 14:56:40.429745 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687c93a7-2160-41d2-ae77-eeefac50a866 req-49a69ffa-3f36-4f55-b9cc-d699cfac44b7 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:40.431240 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-687c93a7-2160-41d2-ae77-eeefac50a866 req-49a69ffa-3f36-4f55-b9cc-d699cfac44b7 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 944 time: 0.0576305 Nov 12 14:56:40.483579 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-687c93a7-2160-41d2-ae77-eeefac50a866 req-1b1a4ced-a5d2-4da8-953d-c6bfde81d789 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461161 Nov 12 14:56:41.191838 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-135ff8a9-58bc-4822-8764-93b01a1fcc1a req-deb1eceb-fd13-4856-8917-c5efb2947d68 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:41.193428 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-135ff8a9-58bc-4822-8764-93b01a1fcc1a req-deb1eceb-fd13-4856-8917-c5efb2947d68 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0552213 Nov 12 14:56:41.243968 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-135ff8a9-58bc-4822-8764-93b01a1fcc1a req-d75bc742-241b-4f45-940c-0b0a4e318591 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441155 Nov 12 14:56:41.611613 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333b3e36-8cdd-451e-8f79-0d1db5c33079 req-d077eb1b-7319-4014-b797-2103c07eec74 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:41.613172 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-333b3e36-8cdd-451e-8f79-0d1db5c33079 req-d077eb1b-7319-4014-b797-2103c07eec74 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 944 time: 0.0570471 Nov 12 14:56:41.661528 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-333b3e36-8cdd-451e-8f79-0d1db5c33079 req-82488e6c-3d5e-482f-90c5-77e6d1944a16 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423868 Nov 12 14:56:42.361979 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9073960-9d4d-42dd-a122-9ec3f79d7d2e req-c42aa154-e20f-4fa5-ac9f-468f2fa437ad tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:42.363431 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c9073960-9d4d-42dd-a122-9ec3f79d7d2e req-c42aa154-e20f-4fa5-ac9f-468f2fa437ad tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0522659 Nov 12 14:56:42.409790 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c9073960-9d4d-42dd-a122-9ec3f79d7d2e req-4d09d4b4-c176-4b88-b454-076c420a251d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404751 Nov 12 14:56:42.687768 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d2b7f476-dd48-4efe-b149-aad19da5171f up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:56:42.743041 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port d2b7f476-dd48-4efe-b149-aad19da5171f completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:56:42.747097 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port d2b7f476-dd48-4efe-b149-aad19da5171f triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:42.747487 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:42.790156 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-526ecd66-0001-4150-97b5-edc673b37085 req-ce19f6e5-3f9a-442a-a2ed-90af4b513308 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:42.792585 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-526ecd66-0001-4150-97b5-edc673b37085 req-ce19f6e5-3f9a-442a-a2ed-90af4b513308 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 944 time: 0.0553813 Nov 12 14:56:42.835082 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:42.849954 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-526ecd66-0001-4150-97b5-edc673b37085 req-58e9554d-e988-47e2-ae8b-fd7b77c7cd00 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510116 Nov 12 14:56:42.859230 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:56:42.861769 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a50475e5-5a8c-473f-be4c-f1f670af2003" -d '{"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-plugged", "status": "completed", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:56:42.877137 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:56:42.886052 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:42.915348 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:56:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de094faa-93d7-4096-a05f-4dd853d8be73 x-openstack-request-id: req-de094faa-93d7-4096-a05f-4dd853d8be73 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:56:42.915635 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-plugged", "status": "completed", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:56:42.915886 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-de094faa-93d7-4096-a05f-4dd853d8be73 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:56:42.916294 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'code': 200} Nov 12 14:56:42.943260 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:43.106473 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7b4200b-4a93-4c0d-b697-bc6908c61959 req-53f0e482-b893-4341-88ac-d4818bcbb944 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:43.108098 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e7b4200b-4a93-4c0d-b697-bc6908c61959 req-53f0e482-b893-4341-88ac-d4818bcbb944 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 1098 time: 0.0421205 Nov 12 14:56:43.159941 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e7b4200b-4a93-4c0d-b697-bc6908c61959 req-15e9908f-8ed9-4afa-ad41-f66fa9891811 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380061 Nov 12 14:56:43.522968 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee56f4a0-8268-440a-bf06-5b2ee724a59a req-1a287c25-dba9-4cdf-9c26-8c6f766cfa25 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:43.524454 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ee56f4a0-8268-440a-bf06-5b2ee724a59a req-1a287c25-dba9-4cdf-9c26-8c6f766cfa25 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0501244 Nov 12 14:56:43.575179 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ee56f4a0-8268-440a-bf06-5b2ee724a59a req-1a21a7ee-44e1-43a8-b91b-c9366853a3d4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443928 Nov 12 14:56:43.979817 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b149a2-184b-4c47-b556-39829065f453 req-88fbbdbb-186c-4199-8f9c-5a43efa8b807 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:43.984604 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-42b149a2-184b-4c47-b556-39829065f453 req-88fbbdbb-186c-4199-8f9c-5a43efa8b807 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0587583 Nov 12 14:56:44.038472 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-42b149a2-184b-4c47-b556-39829065f453 req-a50879d4-07c2-486b-a716-b0cae5f1c073 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492361 Nov 12 14:56:44.100686 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-4c3aeaa0-9906-47b0-a9df-d46f23ac3aaf tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:44.102227 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-4c3aeaa0-9906-47b0-a9df-d46f23ac3aaf tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/networks?id=6ec68ee4-86ea-4750-8c5b-ad6204b38664 HTTP/1.1" status: 200 len: 809 time: 0.1146252 Nov 12 14:56:44.117737 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-c33a195c-1221-4b6e-8c0b-2f5c493acfa2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/quotas/541f7684cc1c484fb8cde1d45d8b538e HTTP/1.1" status: 200 len: 375 time: 0.0095124 Nov 12 14:56:44.150181 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-a1759b07-752f-4e06-8989-3ff6860fbed2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=541f7684cc1c484fb8cde1d45d8b538e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0270460 Nov 12 14:56:44.251781 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-da79a30b-ca16-4659-9325-cb840bba0872 service neutron] 10.222.0.61 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0940688 Nov 12 14:56:44.343098 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-a7a8ce85-4c9b-4840-9335-223b9ddea2ca service neutron] 10.222.0.61 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831580 Nov 12 14:56:44.499390 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e752dbf4-d2b0-4b3b-a611-c0a836afa951 req-e4ba10f8-5486-4a1e-a2b7-83e23374bba2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 210 time: 0.0267942 Nov 12 14:56:44.692871 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48023ed1-6f27-4960-85ac-b92bbddfbb94 req-9b203d20-39ba-41bb-a32a-5924134cb466 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:44.695010 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-48023ed1-6f27-4960-85ac-b92bbddfbb94 req-9b203d20-39ba-41bb-a32a-5924134cb466 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0520496 Nov 12 14:56:44.751649 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-48023ed1-6f27-4960-85ac-b92bbddfbb94 req-b583ff4c-05d6-4e7a-86a5-26ccbf083cd1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500150 Nov 12 14:56:45.158788 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751a19fc-68e0-40e3-96e8-125b14bd0c75 req-8a8d2087-689b-4fe7-b58a-ecc2a0fba53e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:45.160278 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-751a19fc-68e0-40e3-96e8-125b14bd0c75 req-8a8d2087-689b-4fe7-b58a-ecc2a0fba53e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0491285 Nov 12 14:56:45.208053 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-751a19fc-68e0-40e3-96e8-125b14bd0c75 req-b22b12b9-afeb-4fee-ae8c-0fd22b8d1054 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418289 Nov 12 14:56:45.593035 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-27b99b49-398e-4243-81bd-544566591c33 req-cf8f4f63-8929-4913-82c9-470784558242 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 210 time: 0.0260112 Nov 12 14:56:45.867786 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7167670-3905-4902-a496-83d9d4e643ca req-554fb6c8-7b5c-43da-a8a0-d9b399c7b646 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:45.869671 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7167670-3905-4902-a496-83d9d4e643ca req-554fb6c8-7b5c-43da-a8a0-d9b399c7b646 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0495665 Nov 12 14:56:45.922577 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7167670-3905-4902-a496-83d9d4e643ca req-a558da47-ec17-47c8-8a77-99627576ff69 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463598 Nov 12 14:56:46.330890 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec49864c-2d42-49e4-aa67-83f3b71c608d req-f25f0463-8fa2-46a9-9fcf-82f7ba00adfc tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:46.332393 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ec49864c-2d42-49e4-aa67-83f3b71c608d req-f25f0463-8fa2-46a9-9fcf-82f7ba00adfc tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0494699 Nov 12 14:56:46.379833 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ec49864c-2d42-49e4-aa67-83f3b71c608d req-c520d180-3729-4f84-b7cb-014ac271826f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415432 Nov 12 14:56:46.687182 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-595cd9c5-24cb-4d75-aff1-597cf3860850 req-34810a7c-48d2-485f-bbab-aad4e113ed6a tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 210 time: 0.0268013 Nov 12 14:56:47.037962 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e177678f-d6d9-4b71-8b6f-2a8661c766d8 req-3e84c913-be33-4540-9f1f-fe30632e4188 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:47.039463 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e177678f-d6d9-4b71-8b6f-2a8661c766d8 req-3e84c913-be33-4540-9f1f-fe30632e4188 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0498095 Nov 12 14:56:47.090740 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e177678f-d6d9-4b71-8b6f-2a8661c766d8 req-eb67868d-3871-47c8-a078-390300aeec89 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442884 Nov 12 14:56:47.499778 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f1ca68-352f-4018-98ba-bbafc90171c7 req-893534a6-f747-4aac-afe9-cee0b901bfac tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:47.501403 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d3f1ca68-352f-4018-98ba-bbafc90171c7 req-893534a6-f747-4aac-afe9-cee0b901bfac tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0498006 Nov 12 14:56:47.550023 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d3f1ca68-352f-4018-98ba-bbafc90171c7 req-f901f28b-8de9-4dfd-9f8f-19be57d6ae14 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429349 Nov 12 14:56:47.787508 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d059c94-c644-480e-af57-cab246f47be8 req-48d00af6-1fc6-4a01-8a11-b47c2e3ac1d4 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 210 time: 0.0332153 Nov 12 14:56:48.218189 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2db69695-826e-498c-aeec-dd0ebcf3d76e req-00e7b43e-84c4-43ce-88c1-786d0de30fc6 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:48.219858 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2db69695-826e-498c-aeec-dd0ebcf3d76e req-00e7b43e-84c4-43ce-88c1-786d0de30fc6 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0559158 Nov 12 14:56:48.270449 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2db69695-826e-498c-aeec-dd0ebcf3d76e req-fc02fed7-86a7-49c9-bbc7-75b2001c1d88 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443296 Nov 12 14:56:48.682926 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964940ed-99ce-4fb3-9033-7ea10ce173a8 req-33ac095e-39f1-450f-9e27-5dfe53e5bd99 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:48.684629 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-964940ed-99ce-4fb3-9033-7ea10ce173a8 req-33ac095e-39f1-450f-9e27-5dfe53e5bd99 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0535290 Nov 12 14:56:48.801781 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-964940ed-99ce-4fb3-9033-7ea10ce173a8 req-965b482e-e043-442f-97e7-d8e8a45d7da7 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1065323 Nov 12 14:56:48.846536 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-661e0fff-413e-41ab-b76d-13c54c22186e tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:48.848062 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-661e0fff-413e-41ab-b76d-13c54c22186e tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.86 "GET /v2.0/networks?id=6ec68ee4-86ea-4750-8c5b-ad6204b38664 HTTP/1.1" status: 200 len: 809 time: 0.1625447 Nov 12 14:56:48.873131 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Request body: {'port': {'device_id': 'db55f42f-05ed-4dc7-b257-7b4db83cdc96', 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664', 'admin_state_up': True, 'tenant_id': '541f7684cc1c484fb8cde1d45d8b538e'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:48.927892 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-05e503e5-c69d-4ad4-b41b-f9b98927bc97 req-76106f36-28f0-441c-af8b-6e29b9adf222 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 210 time: 0.0505641 Nov 12 14:56:49.066501 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3731a70-ab50-46e6-b2b0-f85be254707e req-0a53faf0-d2d7-4b20-a711-e130d5fffc8f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:49.068022 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c3731a70-ab50-46e6-b2b0-f85be254707e req-0a53faf0-d2d7-4b20-a711-e130d5fffc8f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0766683 Nov 12 14:56:49.076372 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Made reservation on behalf of 541f7684cc1c484fb8cde1d45d8b538e for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:56:49.078025 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 56374) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:49.080441 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:49.094690 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'floatingip': {'port_id': 'd2b7f476-dd48-4efe-b149-aad19da5171f'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:49.179442 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:49.265487 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Allocated IP 172.20.0.6 (6ec68ee4-86ea-4750-8c5b-ad6204b38664/91f83bd1-9576-4d8f-9a67-268c7bf31499/258c1e08-d909-4040-b201-a64fbd6f41cd) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:56:49.489898 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f4c4ba-c849-44d0-85f4-b5c24f8c9e01 req-12c1bc8b-2f99-40b6-aae3-9136dca6cb0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:49.491374 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b8f4c4ba-c849-44d0-85f4-b5c24f8c9e01 req-12c1bc8b-2f99-40b6-aae3-9136dca6cb0f service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 1098 time: 0.1306124 Nov 12 14:56:49.526834 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62f0ed51-853a-4f6e-ac0a-7e8ac541d8f6 req-b4e8b890-1c8a-4665-8732-5c7df8561f1a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:49.528400 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-62f0ed51-853a-4f6e-ac0a-7e8ac541d8f6 req-b4e8b890-1c8a-4665-8732-5c7df8561f1a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.1321640 Nov 12 14:56:49.535519 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:49.578021 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b8f4c4ba-c849-44d0-85f4-b5c24f8c9e01 req-2017a9c9-17f4-41e2-8166-2c22a530e012 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692844 Nov 12 14:56:49.590945 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:49.664446 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:56:49.667957 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:56:49.682640 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:56:49.689110 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:49.690167 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:49.694790 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Pushing event updated for resources: {'Port': ['ID=258c1e08-d909-4040-b201-a64fbd6f41cd,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:49.723151 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-389b7efd-be21-4562-81c5-5353c59aa4a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8541732 Nov 12 14:56:49.746862 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-62f0ed51-853a-4f6e-ac0a-7e8ac541d8f6 req-5587da2f-6598-4d80-8e3d-6953ce094ecc tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1861331 Nov 12 14:56:49.849085 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Request body: {'port': {'device_id': 'db55f42f-05ed-4dc7-b257-7b4db83cdc96', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:56:49.906355 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:50.081151 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.db.resource_extend [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] It took 0.26 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 12 14:56:50.152334 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8778d54-5033-474a-821e-be89798f3323 req-5511f30e-781f-4129-b27c-7a364ca3651b tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:50.153865 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d8778d54-5033-474a-821e-be89798f3323 req-5511f30e-781f-4129-b27c-7a364ca3651b tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 931 time: 0.1074939 Nov 12 14:56:50.162870 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:50.166735 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:50.232971 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d8778d54-5033-474a-821e-be89798f3323 req-dc9966b6-e467-46be-82e5-c3cdf1ce09f9 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720661 Nov 12 14:56:50.272563 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.l3_db [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Floating IP f9a56ed8-901e-4103-8243-d3099350c0b2 associated. External IP: 172.27.3.238, port: d2b7f476-dd48-4efe-b149-aad19da5171f. Nov 12 14:56:50.289547 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 258c1e08-d909-4040-b201-a64fbd6f41cd {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:56:50.297587 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:50.315553 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Transition to ACTIVE for port object 258c1e08-d909-4040-b201-a64fbd6f41cd will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:56:50.319161 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:50.388973 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Pushing event updated for resources: {'Port': ['ID=258c1e08-d909-4040-b201-a64fbd6f41cd,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:50.402535 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Attempting to bind port 258c1e08-d909-4040-b201-a64fbd6f41cd on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:56:50.402903 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Attempting to bind port 258c1e08-d909-4040-b201-a64fbd6f41cd by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '3e64eb13-260c-404a-8e4f-19728a3fbcf8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:56:50.403226 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Attempting to bind port 258c1e08-d909-4040-b201-a64fbd6f41cd on network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:56:50.407816 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Port 258c1e08-d909-4040-b201-a64fbd6f41cd on network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:56:50.408182 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Attempting to bind port 258c1e08-d909-4040-b201-a64fbd6f41cd on network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:56:50.413120 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 56, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:56:50.413444 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Checking segment: {'id': '3e64eb13-260c-404a-8e4f-19728a3fbcf8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:56:50.413835 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Bound using segment: {'id': '3e64eb13-260c-404a-8e4f-19728a3fbcf8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:56:50.414243 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Bound port: 258c1e08-d909-4040-b201-a64fbd6f41cd, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3e64eb13-260c-404a-8e4f-19728a3fbcf8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:56:50.414587 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:50.481545 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] For port 258c1e08-d909-4040-b201-a64fbd6f41cd, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:56:50.485038 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] For port 258c1e08-d909-4040-b201-a64fbd6f41cd, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=258c1e08-d909-4040-b201-a64fbd6f41cd,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:56:50.490206 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:50.491269 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Router 2b5b59a1-46c8-4703-94e6-adf835fba661 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 14:56:50.525320 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:50.525952 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:50.527319 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] 10.222.0.86 "PUT /v2.0/ports/258c1e08-d909-4040-b201-a64fbd6f41cd HTTP/1.1" status: 200 len: 1093 time: 0.6832721 Nov 12 14:56:50.527741 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'db55f42f-05ed-4dc7-b257-7b4db83cdc96', 'tag': '258c1e08-d909-4040-b201-a64fbd6f41cd'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:56:50.530031 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7221cdf5-0ae8-4b90-a9d3-679b73075464" -d '{"events": [{"name": "network-changed", "server_uuid": "db55f42f-05ed-4dc7-b257-7b4db83cdc96", "tag": "258c1e08-d909-4040-b201-a64fbd6f41cd"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:56:50.569842 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:56:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd9092af-e447-4195-9e75-28f20a792dd3 x-openstack-request-id: req-dd9092af-e447-4195-9e75-28f20a792dd3 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:56:50.570129 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "db55f42f-05ed-4dc7-b257-7b4db83cdc96", "tag": "258c1e08-d909-4040-b201-a64fbd6f41cd", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:56:50.570425 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-dd9092af-e447-4195-9e75-28f20a792dd3 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:56:50.570811 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'db55f42f-05ed-4dc7-b257-7b4db83cdc96', 'tag': '258c1e08-d909-4040-b201-a64fbd6f41cd', 'status': 'completed', 'code': 200} Nov 12 14:56:50.571728 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e627a7fe-d12b-4998-8cdb-89d362eff704 service neutron] Pushing event updated for resources: {'Port': ['ID=258c1e08-d909-4040-b201-a64fbd6f41cd,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:50.616968 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-12f52a87-3920-4f11-a90a-5d4be68c13bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:50.618457 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-12f52a87-3920-4f11-a90a-5d4be68c13bb service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=541f7684cc1c484fb8cde1d45d8b538e&device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 1096 time: 0.0422761 Nov 12 14:56:50.625513 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:56:50.630483 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:50.635201 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b603b943-1729-40db-924a-f76ce877abcd None None] Sync routers for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:56:50.646354 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b603b943-1729-40db-924a-f76ce877abcd None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:56:50.647146 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-b603b943-1729-40db-924a-f76ce877abcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:56:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:50.663646 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6e986617-2db9-4844-8cd5-c2efe09bc233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "PUT /v2.0/floatingips/f9a56ed8-901e-4103-8243-d3099350c0b2 HTTP/1.1" status: 200 len: 991 time: 1.5819576 Nov 12 14:56:50.663646 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f'}] {{(pid=101617) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:56:50.664648 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a89741189a1474522a3f12d6512a4dfa907db76ed85a3c525a03538a87d7317" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a785fcfe-8ffe-463b-853a-ac997d386cb5" -d '{"events": [{"name": "network-changed", "server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f"}]}' {{(pid=101617) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:56:50.689920 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-93e2e76b-d302-4296-9c04-fff90ceeb6f0 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=258c1e08-d909-4040-b201-a64fbd6f41cd HTTP/1.1" status: 200 len: 217 time: 0.0507696 Nov 12 14:56:50.730247 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:56:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5ad8cd6b-0078-4347-8436-a66cefb8fc50 x-openstack-request-id: req-5ad8cd6b-0078-4347-8436-a66cefb8fc50 {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:56:50.730887 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f", "status": "completed", "code": 200}]} {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:56:50.731309 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-5ad8cd6b-0078-4347-8436-a66cefb8fc50 {{(pid=101617) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:56:50.732056 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'status': 'completed', 'code': 200} Nov 12 14:56:50.792264 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-5b41cc58-dff3-4b9b-b7f5-43eb6785428c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:50.793764 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-5b41cc58-dff3-4b9b-b7f5-43eb6785428c service neutron] 10.222.0.86 "GET /v2.0/subnets?id=91f83bd1-9576-4d8f-9a67-268c7bf31499 HTTP/1.1" status: 200 len: 849 time: 0.0937388 Nov 12 14:56:50.840699 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-a55237e8-806b-48b9-935f-5f393f9f3dd7 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6ec68ee4-86ea-4750-8c5b-ad6204b38664&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0381374 Nov 12 14:56:50.842881 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-19d10ce3-c97f-450f-a883-a3f581c0dfb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:50.844879 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-19d10ce3-c97f-450f-a883-a3f581c0dfb9 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 1098 time: 0.0851901 Nov 12 14:56:50.887389 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-b603b943-1729-40db-924a-f76ce877abcd None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:56:50.972530 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a8c10e1-c868-4642-b8f3-3a54c16c7155 req-c3a1fe61-7c27-4243-bd67-2b00b2f0c2b9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:50.974144 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0a8c10e1-c868-4642-b8f3-3a54c16c7155 req-c3a1fe61-7c27-4243-bd67-2b00b2f0c2b9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0634739 Nov 12 14:56:51.042271 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0a8c10e1-c868-4642-b8f3-3a54c16c7155 req-d6390f87-dbd2-4024-909a-dc2d4a0f9e53 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612280 Nov 12 14:56:51.103230 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-a8ecb27f-4a5a-48b5-98fc-c5b061f8d23c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:51.104859 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-a8ecb27f-4a5a-48b5-98fc-c5b061f8d23c service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.2322483 Nov 12 14:56:51.110972 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-db2dfb8a-995c-4a81-b42a-8460c9bc3aa4 service neutron] 10.222.0.86 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2504838 Nov 12 14:56:51.204908 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-b603b943-1729-40db-924a-f76ce877abcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': 'f9a56ed8-901e-4103-8243-d3099350c0b2', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'port_id': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 312, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'mac_address': 'fa:16:3e:67:8f:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82360b9e-d05e-4010-8b74-d862c5e66562', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T14:56:26Z', 'updated_at': '2021-11-12T14:56:49Z', 'revision_number': 1, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:51.231245 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b603b943-1729-40db-924a-f76ce877abcd None None] Checking router: 2b5b59a1-46c8-4703-94e6-adf835fba661 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:56:51.241073 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b603b943-1729-40db-924a-f76ce877abcd None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:56:51.241708 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-2e4f542a-c098-4d70-a802-3981d80eff3b service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d2b7f476-dd48-4efe-b149-aad19da5171f HTTP/1.1" status: 200 len: 999 time: 0.1196194 Nov 12 14:56:51.241832 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-b603b943-1729-40db-924a-f76ce877abcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:56:24Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:51.300234 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17b69ec-17f1-4dc8-92aa-c4869fc7e6c0 req-a47bd760-6dcc-4f96-91fd-2b7befd3ea9a service neutron] 10.222.0.86 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1755860 Nov 12 14:56:51.308594 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-ce547162-e45e-4080-b935-d629de9c7c7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:51.310033 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-ce547162-e45e-4080-b935-d629de9c7c7d service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0609393 Nov 12 14:56:51.355624 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-b603b943-1729-40db-924a-f76ce877abcd None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:56:51.381734 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-af5bb076-60c4-4ac2-8a6e-7f27118a563c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:51.383462 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-af5bb076-60c4-4ac2-8a6e-7f27118a563c service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0654378 Nov 12 14:56:51.392566 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe7fbc6-f99d-42d9-8f33-003c1686fb5c req-1d5ea05f-37ac-497b-a10e-9632090d7f82 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:51.394051 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-dbe7fbc6-f99d-42d9-8f33-003c1686fb5c req-1d5ea05f-37ac-497b-a10e-9632090d7f82 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 943 time: 0.0715075 Nov 12 14:56:51.453719 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-dbe7fbc6-f99d-42d9-8f33-003c1686fb5c req-43c4f53a-be81-4b40-abbc-771ff508307c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518155 Nov 12 14:56:51.507026 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-8cbe03d0-f395-468c-ab97-b3a22d8d6888 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:51.508553 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-8cbe03d0-f395-468c-ab97-b3a22d8d6888 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=541f7684cc1c484fb8cde1d45d8b538e&device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 1096 time: 0.0971110 Nov 12 14:56:51.535694 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-366c1c86-593f-420a-a554-c19d3cfe4d92 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1328409 Nov 12 14:56:51.604385 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-b603b943-1729-40db-924a-f76ce877abcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': 'f9a56ed8-901e-4103-8243-d3099350c0b2', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'port_id': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 312, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'mac_address': 'fa:16:3e:67:8f:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82360b9e-d05e-4010-8b74-d862c5e66562', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T14:56:26Z', 'updated_at': '2021-11-12T14:56:49Z', 'revision_number': 1, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:56:51.630402 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b603b943-1729-40db-924a-f76ce877abcd None None] The sync data for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi is: [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': 'f9a56ed8-901e-4103-8243-d3099350c0b2', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'floating_ip_address': '172.27.3.238', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'port_id': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 312, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'mac_address': 'fa:16:3e:67:8f:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '82360b9e-d05e-4010-8b74-d862c5e66562', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T14:56:26Z', 'updated_at': '2021-11-12T14:56:49Z', 'revision_number': 1, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:56:51.684860 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-aad54286-e054-4b23-acf1-1d912426ec49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:51.686362 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-aad54286-e054-4b23-acf1-1d912426ec49 service neutron] 10.222.0.86 "GET /v2.0/networks?id=6ec68ee4-86ea-4750-8c5b-ad6204b38664 HTTP/1.1" status: 200 len: 910 time: 0.1609702 Nov 12 14:56:51.692231 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a785fcfe-8ffe-463b-853a-ac997d386cb5 req-5a3fd649-ccea-4ec1-b7e2-97781bc3b333 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1465924 Nov 12 14:56:51.748514 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-f37ac676-7133-49f0-8b6d-e6387b7ab07d service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=258c1e08-d909-4040-b201-a64fbd6f41cd HTTP/1.1" status: 200 len: 217 time: 0.0409448 Nov 12 14:56:51.816837 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-a39d814b-6c10-42ca-bc8f-ccc320a4ee2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:51.819083 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-a39d814b-6c10-42ca-bc8f-ccc320a4ee2d service neutron] 10.222.0.86 "GET /v2.0/subnets?id=91f83bd1-9576-4d8f-9a67-268c7bf31499 HTTP/1.1" status: 200 len: 849 time: 0.0494425 Nov 12 14:56:51.838875 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7ea8a1d-d871-49d5-9655-b1537b3a3c26 None None] New status for floating IP f9a56ed8-901e-4103-8243-d3099350c0b2: ACTIVE {{(pid=101619) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 14:56:51.854273 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-8be2030b-a463-4b6b-805c-f4d4bca20244 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6ec68ee4-86ea-4750-8c5b-ad6204b38664&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0263057 Nov 12 14:56:51.960592 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-df638241-383d-4cba-8692-6bd7e2a71e9b service neutron] 10.222.0.86 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906615 Nov 12 14:56:52.102583 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-51b59653-0b6d-45bc-a423-64dd5e02cab7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:52.191286 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fe910b1-feec-4550-8416-3139eb4d9eaf req-dd83bb16-fb8b-46d8-9cb7-eb93657fbd0d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:52.193177 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5fe910b1-feec-4550-8416-3139eb4d9eaf req-dd83bb16-fb8b-46d8-9cb7-eb93657fbd0d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0532322 Nov 12 14:56:52.278183 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5fe910b1-feec-4550-8416-3139eb4d9eaf req-d481a30d-0dc3-4f7f-b118-b25ef82b50f6 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738928 Nov 12 14:56:52.318004 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7221cdf5-0ae8-4b90-a9d3-679b73075464 req-0b2358d8-2511-418f-b64b-9efbe0d00b0e service neutron] 10.222.0.86 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3483450 Nov 12 14:56:52.415063 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07faa99c-8083-4291-bb25-a10a33718605 req-bc7023b0-75e0-4566-9eee-9e0acce4a3f7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:52.417224 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-07faa99c-8083-4291-bb25-a10a33718605 req-bc7023b0-75e0-4566-9eee-9e0acce4a3f7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0622673 Nov 12 14:56:52.485290 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-07faa99c-8083-4291-bb25-a10a33718605 req-ab74c23d-9c78-43f9-a50b-0494bf1a55d7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0616171 Nov 12 14:56:52.581152 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2801536-89a7-4cce-8994-974cbe4f132f req-b42d9578-b72c-48c3-8ab2-d3473d632774 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:52.582638 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c2801536-89a7-4cce-8994-974cbe4f132f req-b42d9578-b72c-48c3-8ab2-d3473d632774 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 943 time: 0.0514541 Nov 12 14:56:52.641538 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c2801536-89a7-4cce-8994-974cbe4f132f req-528691fd-f77a-4af1-b029-256f95154337 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520623 Nov 12 14:56:53.772099 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687241ca-22ac-418e-89ba-417893aa3462 req-3a2c8a59-9de6-49d9-941f-2b468281e366 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:53.773675 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-687241ca-22ac-418e-89ba-417893aa3462 req-3a2c8a59-9de6-49d9-941f-2b468281e366 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 943 time: 0.0537281 Nov 12 14:56:53.821224 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-687241ca-22ac-418e-89ba-417893aa3462 req-b6169a99-9feb-4054-8bb7-724f4e0f7841 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414929 Nov 12 14:56:54.059076 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-5f5eaa49-8cd0-45d9-8fe0-7f453d2756b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:54.060606 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a995dc-7f7b-4105-85be-4ceb4bfcf753 req-217fe215-f013-4376-8541-ab702df7dd14 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:54.060764 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-5f5eaa49-8cd0-45d9-8fe0-7f453d2756b8 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1098 time: 0.0417461 Nov 12 14:56:54.062210 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-46a995dc-7f7b-4105-85be-4ceb4bfcf753 req-217fe215-f013-4376-8541-ab702df7dd14 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0518053 Nov 12 14:56:54.111857 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-46a995dc-7f7b-4105-85be-4ceb4bfcf753 req-f0f196dd-1ab2-48e3-b281-c1ae5438ac75 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436604 Nov 12 14:56:54.156790 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-e72f8756-ec31-465f-8e2c-741f153e467a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:54.158259 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-e72f8756-ec31-465f-8e2c-741f153e467a service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 919 time: 0.0887103 Nov 12 14:56:54.373869 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 56524) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:54.476575 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-29283062-17e2-4531-9363-45f6c6263b3e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:54.511486 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e6d931da-020a-486b-b317-dd0770b2c073 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:54.557960 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-29283062-17e2-4531-9363-45f6c6263b3e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:54.562521 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-29283062-17e2-4531-9363-45f6c6263b3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:54.602812 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-29283062-17e2-4531-9363-45f6c6263b3e admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=05b4e4985c614be2b6858c18bb333d8b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2278774 Nov 12 14:56:54.603653 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29283062-17e2-4531-9363-45f6c6263b3e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbe5a059-1af5-4e2d-b28e-3375002bb50e,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:54.605604 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 56532) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:56:54.657850 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b6f2374a-1810-44c4-9126-41a56b2bddaa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:54.678798 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b6f2374a-1810-44c4-9126-41a56b2bddaa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:54.724631 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b6f2374a-1810-44c4-9126-41a56b2bddaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:54.727526 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b6f2374a-1810-44c4-9126-41a56b2bddaa admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:54.728701 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b6f2374a-1810-44c4-9126-41a56b2bddaa admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/dbe5a059-1af5-4e2d-b28e-3375002bb50e HTTP/1.1" status: 204 len: 168 time: 0.1220274 Nov 12 14:56:54.737119 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6f2374a-1810-44c4-9126-41a56b2bddaa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbe5a059-1af5-4e2d-b28e-3375002bb50e,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:54.936499 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0c91a97-bf27-4265-8212-93b52fa4d485 req-864e1294-d90e-4234-9c82-ad11e149e649 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:54.937987 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a0c91a97-bf27-4265-8212-93b52fa4d485 req-864e1294-d90e-4234-9c82-ad11e149e649 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 943 time: 0.0506127 Nov 12 14:56:54.986429 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a0c91a97-bf27-4265-8212-93b52fa4d485 req-0ce2ac22-0b6f-4b2e-8e84-2795e2cc9325 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426970 Nov 12 14:56:55.266880 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 258c1e08-d909-4040-b201-a64fbd6f41cd details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:56:55.362988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 258c1e08-d909-4040-b201-a64fbd6f41cd, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=258c1e08-d909-4040-b201-a64fbd6f41cd,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:56:55.375585 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '258c1e08-d909-4040-b201-a64fbd6f41cd', 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664', 'port_id': '258c1e08-d909-4040-b201-a64fbd6f41cd', 'mac_address': 'fa:16:3e:26:08:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 601, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '91f83bd1-9576-4d8f-9a67-268c7bf31499', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:56:55.419983 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:55.432563 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 258c1e08-d909-4040-b201-a64fbd6f41cd {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:56:55.452486 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 258c1e08-d909-4040-b201-a64fbd6f41cd, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=258c1e08-d909-4040-b201-a64fbd6f41cd,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:56:55.456750 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:55.514377 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=258c1e08-d909-4040-b201-a64fbd6f41cd,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:56:55.524498 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:56.904332 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:57.328704 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-66b96508-a078-4a7b-9e53-42d688d7fe20 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18 HTTP/1.1" status: 200 len: 217 time: 0.0351746 Nov 12 14:56:57.414941 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-e29c3cce-63ec-4c58-a457-feeed906723d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:57.416406 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-e29c3cce-63ec-4c58-a457-feeed906723d service neutron] 10.222.0.86 "GET /v2.0/subnets?id=03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 200 len: 858 time: 0.0526137 Nov 12 14:56:57.440223 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e68254-06cf-4bb1-952a-2b807e7d2987 req-33cac4f4-2604-404d-893a-87e3ba14a12a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:57.441781 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a7e68254-06cf-4bb1-952a-2b807e7d2987 req-33cac4f4-2604-404d-893a-87e3ba14a12a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0502434 Nov 12 14:56:57.471147 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-d21f24ea-a0a8-4c15-a069-550c115ebf4f service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0387566 Nov 12 14:56:57.489315 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a7e68254-06cf-4bb1-952a-2b807e7d2987 req-49cc773c-f085-4965-b911-1255fc2fbf01 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412321 Nov 12 14:56:57.491244 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cfede05-af34-4072-8b21-d2257a9613db req-f8372f4c-c720-45a9-bb30-f409b6f758f7 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:57.492758 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1cfede05-af34-4072-8b21-d2257a9613db req-f8372f4c-c720-45a9-bb30-f409b6f758f7 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 944 time: 0.0688643 Nov 12 14:56:57.601506 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1cfede05-af34-4072-8b21-d2257a9613db req-c5e989af-feaa-4860-bbb0-562d1fbef2b5 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0987034 Nov 12 14:56:57.617522 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-dca0c06d-ad1b-4c9e-800a-edee34ea1eb9 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1238246 Nov 12 14:56:57.650432 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['258c1e08-d909-4040-b201-a64fbd6f41cd'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:56:57.715474 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-46b9c0a0-9966-47b5-9854-1cc36e091c59 req-11021c46-5208-4ca8-aa8b-35f671c18836 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881341 Nov 12 14:56:57.888007 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:58.636026 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed6a44d-d573-4528-ace4-fe60e95280b1 req-df7f1ca3-a0c2-442b-85ef-cebc782adb04 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:58.637601 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-aed6a44d-d573-4528-ace4-fe60e95280b1 req-df7f1ca3-a0c2-442b-85ef-cebc782adb04 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0521426 Nov 12 14:56:58.690560 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-aed6a44d-d573-4528-ace4-fe60e95280b1 req-5e59d7b4-cdf9-4bfa-8f71-eac1c6a55314 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468812 Nov 12 14:56:58.725509 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbbe64f-3ffd-4224-aaef-36df913a430b req-0bba058d-1fb5-485c-be5b-45fb30094754 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:56:58.727064 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1bbbe64f-3ffd-4224-aaef-36df913a430b req-0bba058d-1fb5-485c-be5b-45fb30094754 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 944 time: 0.0562310 Nov 12 14:56:58.775260 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1bbbe64f-3ffd-4224-aaef-36df913a430b req-c3fb759b-03e3-4586-a466-b4becc73c636 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415699 Nov 12 14:56:59.859117 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 258c1e08-d909-4040-b201-a64fbd6f41cd up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:56:59.906935 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 258c1e08-d909-4040-b201-a64fbd6f41cd completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:56:59.911105 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 258c1e08-d909-4040-b201-a64fbd6f41cd triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:56:59.911472 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:56:59.988425 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:00.011450 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'db55f42f-05ed-4dc7-b257-7b4db83cdc96', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '258c1e08-d909-4040-b201-a64fbd6f41cd'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:57:00.014265 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-34ede078-7bb2-4796-9314-af86ddb2b019" -d '{"events": [{"server_uuid": "db55f42f-05ed-4dc7-b257-7b4db83cdc96", "name": "network-vif-plugged", "status": "completed", "tag": "258c1e08-d909-4040-b201-a64fbd6f41cd"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:57:00.026524 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 258c1e08-d909-4040-b201-a64fbd6f41cd, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=258c1e08-d909-4040-b201-a64fbd6f41cd,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:57:00.030636 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:00.075246 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=258c1e08-d909-4040-b201-a64fbd6f41cd,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:02.014366 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e0bf10f-70fa-4a38-8287-8f40c4c10bc4 req-bbc193a6-cb66-46b2-9d51-b277ea47927c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:02.019314 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3e0bf10f-70fa-4a38-8287-8f40c4c10bc4 req-bbc193a6-cb66-46b2-9d51-b277ea47927c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0572767 Nov 12 14:57:02.065652 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3e0bf10f-70fa-4a38-8287-8f40c4c10bc4 req-ec42da6d-c4a3-4468-8db6-2d7b6be9f861 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434327 Nov 12 14:57:02.073265 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398a3678-167d-4152-882e-73fcb8e4d87d req-72dd47dd-6d92-437a-9697-5c09cd295acc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:02.074754 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-398a3678-167d-4152-882e-73fcb8e4d87d req-72dd47dd-6d92-437a-9697-5c09cd295acc service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1098 time: 0.0683694 Nov 12 14:57:02.095761 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98624fa1-8142-4295-8fde-de1906fdd1c0 req-9f6c3877-26eb-4f58-875f-6162caed280f tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:02.097650 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98624fa1-8142-4295-8fde-de1906fdd1c0 req-9f6c3877-26eb-4f58-875f-6162caed280f tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0827401 Nov 12 14:57:02.115169 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:57:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f8efe673-caf2-4438-b0c6-12e8f6da3546 x-openstack-request-id: req-f8efe673-caf2-4438-b0c6-12e8f6da3546 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:57:02.115678 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "db55f42f-05ed-4dc7-b257-7b4db83cdc96", "name": "network-vif-plugged", "status": "completed", "tag": "258c1e08-d909-4040-b201-a64fbd6f41cd", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:57:02.115847 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f8efe673-caf2-4438-b0c6-12e8f6da3546 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:57:02.116359 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'db55f42f-05ed-4dc7-b257-7b4db83cdc96', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '258c1e08-d909-4040-b201-a64fbd6f41cd', 'code': 200} Nov 12 14:57:02.216481 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98624fa1-8142-4295-8fde-de1906fdd1c0 req-7d91d356-ab3a-4dce-bb1a-bdb4c8465598 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1115003 Nov 12 14:57:02.239279 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398a3678-167d-4152-882e-73fcb8e4d87d req-6e5cbc7f-8846-435d-baca-1dd795489f09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:02.241142 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-398a3678-167d-4152-882e-73fcb8e4d87d req-6e5cbc7f-8846-435d-baca-1dd795489f09 service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 919 time: 0.1294322 Nov 12 14:57:02.347451 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-398a3678-167d-4152-882e-73fcb8e4d87d req-1b7382c3-b519-4ebb-808c-e8c4199f36ea service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18 HTTP/1.1" status: 200 len: 217 time: 0.0574250 Nov 12 14:57:02.363600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93722f06-fedd-4e03-80c5-902141a78d18 req-fb29c64f-246c-4b84-9a5f-8e8e26aad08e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:02.365149 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-93722f06-fedd-4e03-80c5-902141a78d18 req-fb29c64f-246c-4b84-9a5f-8e8e26aad08e service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 1098 time: 0.0683815 Nov 12 14:57:02.430193 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398a3678-167d-4152-882e-73fcb8e4d87d req-dcbcd244-486e-4c1a-800c-97f39b0bbada service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:02.431614 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-398a3678-167d-4152-882e-73fcb8e4d87d req-dcbcd244-486e-4c1a-800c-97f39b0bbada service neutron] 10.222.0.86 "GET /v2.0/subnets?id=03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 200 len: 858 time: 0.0656338 Nov 12 14:57:02.441332 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-93722f06-fedd-4e03-80c5-902141a78d18 req-64981c3c-0e4c-47d4-a8f5-3cb43f91d4eb service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504231 Nov 12 14:57:02.754860 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-398a3678-167d-4152-882e-73fcb8e4d87d req-8ef76cf7-694f-41b4-a7a8-6e04a672997f service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0283115 Nov 12 14:57:02.853874 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-398a3678-167d-4152-882e-73fcb8e4d87d req-8bd956b7-05ac-499f-80cb-04fd43e202a6 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893865 Nov 12 14:57:02.952184 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-398a3678-167d-4152-882e-73fcb8e4d87d req-17e1b433-e6e4-4da9-9cf3-9860a7b94aab service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868697 Nov 12 14:57:03.192247 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a63e404-0e58-4f4c-a4be-4a39f98a6867 req-ee79e7cb-3ed6-45e2-94cb-22ad823f7ca2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:03.194248 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2a63e404-0e58-4f4c-a4be-4a39f98a6867 req-ee79e7cb-3ed6-45e2-94cb-22ad823f7ca2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0571024 Nov 12 14:57:03.278940 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2a63e404-0e58-4f4c-a4be-4a39f98a6867 req-2f5734af-eeea-4384-a302-9d0b6c33f117 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764914 Nov 12 14:57:03.375431 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8c6fd5e-b479-4fa3-8bc7-f7e1c1f8b0a9 req-14752a51-7ce6-4798-8ef0-40f77fff1845 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:03.377036 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e8c6fd5e-b479-4fa3-8bc7-f7e1c1f8b0a9 req-14752a51-7ce6-4798-8ef0-40f77fff1845 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0578983 Nov 12 14:57:03.435970 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e8c6fd5e-b479-4fa3-8bc7-f7e1c1f8b0a9 req-daef2076-995f-4e6a-978c-b0d3cd0df415 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518177 Nov 12 14:57:04.409823 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf4182de-0de4-4f61-af9c-cea6fd09ce9a req-9a65f0b4-6edb-4821-935d-9433669553a8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:04.411797 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cf4182de-0de4-4f61-af9c-cea6fd09ce9a req-9a65f0b4-6edb-4821-935d-9433669553a8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0613859 Nov 12 14:57:04.467915 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cf4182de-0de4-4f61-af9c-cea6fd09ce9a req-941656c3-6896-4898-89ed-0ec2f7c63cd1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485203 Nov 12 14:57:04.578363 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adadd6e9-7fdf-4cb0-803d-d5521ef0c07d req-515fbb8b-c966-4199-943b-606cdccd65bb tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:04.579804 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-adadd6e9-7fdf-4cb0-803d-d5521ef0c07d req-515fbb8b-c966-4199-943b-606cdccd65bb tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0489547 Nov 12 14:57:04.629749 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-adadd6e9-7fdf-4cb0-803d-d5521ef0c07d req-580003f7-eeb0-4570-94fb-ecd4e2bcf242 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441656 Nov 12 14:57:04.932211 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:05.583911 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d9a640a-c78b-4227-bbe4-ee68cdc666c5 req-bc389aec-8bc5-4ea8-a9bf-5cf1e53de56a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:05.585432 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7d9a640a-c78b-4227-bbe4-ee68cdc666c5 req-bc389aec-8bc5-4ea8-a9bf-5cf1e53de56a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0497460 Nov 12 14:57:05.631707 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7d9a640a-c78b-4227-bbe4-ee68cdc666c5 req-3a78c76e-7e18-4705-bf25-0b8fc6d6a028 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404000 Nov 12 14:57:05.743693 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8993f79d-c715-42f5-aebb-dd5accfcc802 req-ab40f1d0-068e-44a7-9afd-22046c56f7ee tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:05.745216 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8993f79d-c715-42f5-aebb-dd5accfcc802 req-ab40f1d0-068e-44a7-9afd-22046c56f7ee tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0495951 Nov 12 14:57:05.792989 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8993f79d-c715-42f5-aebb-dd5accfcc802 req-ffc646fa-14ae-465c-94a7-acb700ece5af tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419576 Nov 12 14:57:06.753661 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b43ea9b0-40dd-46f0-9860-b3f9d69520e2 req-22c3b121-2f7c-4860-bfb7-09c72f374cde tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:06.755119 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b43ea9b0-40dd-46f0-9860-b3f9d69520e2 req-22c3b121-2f7c-4860-bfb7-09c72f374cde tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0534563 Nov 12 14:57:06.801554 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b43ea9b0-40dd-46f0-9860-b3f9d69520e2 req-0c5bdfda-09c9-4dff-8bce-7a3f3cd704e0 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404439 Nov 12 14:57:06.909641 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f88158-78a7-4dfb-87da-da770cc37816 req-f98d8f58-df5a-4640-92bb-42f6fcaa5e44 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:06.911000 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e6f88158-78a7-4dfb-87da-da770cc37816 req-f98d8f58-df5a-4640-92bb-42f6fcaa5e44 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0494862 Nov 12 14:57:06.957263 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e6f88158-78a7-4dfb-87da-da770cc37816 req-45222d60-ea40-4073-a36b-227f0ef01058 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403948 Nov 12 14:57:07.918691 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10be9fe8-2796-48a1-984e-224ee77a72d1 req-b87fa9a6-d6b4-4156-b633-05cf70faa210 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:07.920719 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10be9fe8-2796-48a1-984e-224ee77a72d1 req-b87fa9a6-d6b4-4156-b633-05cf70faa210 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0511162 Nov 12 14:57:07.973551 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10be9fe8-2796-48a1-984e-224ee77a72d1 req-5e8af4e0-3f33-402b-840c-34b0b1e7ca20 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469968 Nov 12 14:57:08.074841 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-006e2640-4774-4a9a-972c-50966ad4cc7e req-fb62cb21-b52f-4212-b5e9-ab1d65481dd6 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:08.076323 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-006e2640-4774-4a9a-972c-50966ad4cc7e req-fb62cb21-b52f-4212-b5e9-ab1d65481dd6 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0481615 Nov 12 14:57:08.123028 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-006e2640-4774-4a9a-972c-50966ad4cc7e req-af7c971f-c6e2-44e5-9656-c4c5d9c30a76 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402994 Nov 12 14:57:09.086547 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eb35934-c95e-4d7e-bef8-b829e7baac57 req-e262766f-573c-4259-9d98-dbbb2d24054f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:09.088022 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9eb35934-c95e-4d7e-bef8-b829e7baac57 req-e262766f-573c-4259-9d98-dbbb2d24054f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0474877 Nov 12 14:57:09.147577 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9eb35934-c95e-4d7e-bef8-b829e7baac57 req-6ceeacd8-8df8-4748-9a3c-a635c3e0cc9a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519631 Nov 12 14:57:09.446324 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93cabbc-036e-4a9f-b816-c213a03fb385 req-9b64627a-7429-45df-989e-22a5994fa66b tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:09.447789 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e93cabbc-036e-4a9f-b816-c213a03fb385 req-9b64627a-7429-45df-989e-22a5994fa66b tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0476196 Nov 12 14:57:09.494902 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e93cabbc-036e-4a9f-b816-c213a03fb385 req-e3c49b2a-5e1d-42f5-997a-b24682c6301c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397081 Nov 12 14:57:10.033570 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 56806) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:10.152617 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:10.240054 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:10.244650 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:10.266857 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db1246c-d033-4bbc-ad82-8684c00c0e2a req-8b75c49d-3077-44aa-a949-3071013e48d4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:10.268392 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9db1246c-d033-4bbc-ad82-8684c00c0e2a req-8b75c49d-3077-44aa-a949-3071013e48d4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0489085 Nov 12 14:57:10.283996 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=81f8b30ce2f44d3da8d26b05a47cce34&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2482123 Nov 12 14:57:10.285051 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d8666be-be07-44f1-92b0-3ce8f302caac,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:10.287028 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 56812) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:10.307408 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.307756 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.308386 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.308729 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.309064 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.309407 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.309751 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.310079 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.310412 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.310725 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.311044 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.311368 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-069b85b4-3655-40f6-9d17-d32aaccd9a75 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:10.317065 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9db1246c-d033-4bbc-ad82-8684c00c0e2a req-ad11fcb8-f691-46b9-9639-0ee42a5b94b9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422089 Nov 12 14:57:10.354446 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-d4563b49-2425-498b-a8be-02c25c3e049a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:10.376213 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-d4563b49-2425-498b-a8be-02c25c3e049a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:10.420914 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-d4563b49-2425-498b-a8be-02c25c3e049a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:10.423459 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-d4563b49-2425-498b-a8be-02c25c3e049a admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:10.424616 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-d4563b49-2425-498b-a8be-02c25c3e049a admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/2d8666be-be07-44f1-92b0-3ce8f302caac HTTP/1.1" status: 204 len: 168 time: 0.1367040 Nov 12 14:57:10.432042 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4563b49-2425-498b-a8be-02c25c3e049a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d8666be-be07-44f1-92b0-3ce8f302caac,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:10.623502 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145592ef-aa77-4a5e-912b-4478004d1907 req-eefccb5f-2726-448d-8edd-f51376772e73 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:10.632079 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-145592ef-aa77-4a5e-912b-4478004d1907 req-eefccb5f-2726-448d-8edd-f51376772e73 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0604463 Nov 12 14:57:10.682018 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-145592ef-aa77-4a5e-912b-4478004d1907 req-6b46f47b-b896-4470-92eb-f6b0f4fea3ab tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500460 Nov 12 14:57:11.041809 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 56834) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:11.153662 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-dba9205f-a7fa-430a-9a48-9c771ca2d437 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.235758 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-dba9205f-a7fa-430a-9a48-9c771ca2d437 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.240173 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-dba9205f-a7fa-430a-9a48-9c771ca2d437 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.280747 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-dba9205f-a7fa-430a-9a48-9c771ca2d437 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=662c2697c5f94acfbd61447e1474daea&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2378676 Nov 12 14:57:11.281589 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dba9205f-a7fa-430a-9a48-9c771ca2d437 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f0172f8-d668-4aee-a13c-20582e5da8d4,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:11.283965 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 56842) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:11.332643 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.334430 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:57:11.355529 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.405852 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.408602 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.409984 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/6f0172f8-d668-4aee-a13c-20582e5da8d4 HTTP/1.1" status: 204 len: 168 time: 0.1245413 Nov 12 14:57:11.418189 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f0172f8-d668-4aee-a13c-20582e5da8d4,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:11.427122 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.427468 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.427806 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.428158 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.428486 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.428810 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.429134 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.429461 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.429782 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.430228 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.430633 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.430851 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99cce64e-163d-4e87-abf0-398cfc1dd355 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:11.439490 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-048646a9-4453-43c6-a5af-a73c39cb33f7 req-e488934b-f3d4-479b-9d08-cdbdcc4e9ecc tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:11.441484 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-048646a9-4453-43c6-a5af-a73c39cb33f7 req-e488934b-f3d4-479b-9d08-cdbdcc4e9ecc tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0514104 Nov 12 14:57:11.494716 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-048646a9-4453-43c6-a5af-a73c39cb33f7 req-3665b918-b519-4ffd-a3c8-a34a7bf7e2cf tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469122 Nov 12 14:57:11.543077 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-1825b724-0383-48ba-b539-1de07c9118f6 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:11.544644 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-1825b724-0383-48ba-b539-1de07c9118f6 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.86 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0632765 Nov 12 14:57:11.641104 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Deleting port 258c1e08-d909-4040-b201-a64fbd6f41cd {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:57:11.641458 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.739983 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] For port 258c1e08-d909-4040-b201-a64fbd6f41cd, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=258c1e08-d909-4040-b201-a64fbd6f41cd,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:57:11.740530 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.755447 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Calling delete_port for 258c1e08-d909-4040-b201-a64fbd6f41cd owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:57:11.871994 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2867cde4-bb70-4243-9990-5505533fbc4c req-aa8e136f-a1ba-41b2-a283-15e281917af9 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:11.874144 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2867cde4-bb70-4243-9990-5505533fbc4c req-aa8e136f-a1ba-41b2-a283-15e281917af9 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=db55f42f-05ed-4dc7-b257-7b4db83cdc96 HTTP/1.1" status: 200 len: 945 time: 0.0756824 Nov 12 14:57:11.962042 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2867cde4-bb70-4243-9990-5505533fbc4c req-d4b0a219-e34d-458c-a28f-c4d00411afde tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779328 Nov 12 14:57:11.963212 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:11.975818 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['258c1e08-d909-4040-b201-a64fbd6f41cd'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:57:11.994344 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Pushing event deleted for resources: {'Port': ['ID=258c1e08-d909-4040-b201-a64fbd6f41cd,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:12.043740 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] No DVR routers for this DVR port 258c1e08-d909-4040-b201-a64fbd6f41cd on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 14:57:12.047465 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:12.050822 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b17cb7e2-e83f-4bd6-afb0-03b71e70f6f8 req-89584711-e21c-4a7c-a1d9-f29132090869 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.86 "DELETE /v2.0/ports/258c1e08-d909-4040-b201-a64fbd6f41cd HTTP/1.1" status: 204 len: 173 time: 0.4973438 Nov 12 14:57:12.051267 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'db55f42f-05ed-4dc7-b257-7b4db83cdc96', 'name': 'network-vif-deleted', 'tag': '258c1e08-d909-4040-b201-a64fbd6f41cd'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:57:12.053545 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d33c7335-d4a7-4e35-b0a9-b8d566f32e1d" -d '{"events": [{"server_uuid": "db55f42f-05ed-4dc7-b257-7b4db83cdc96", "name": "network-vif-deleted", "tag": "258c1e08-d909-4040-b201-a64fbd6f41cd"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:57:12.095378 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:57:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b37024ca-77ea-4a04-a4bd-0263722bef28 x-openstack-request-id: req-b37024ca-77ea-4a04-a4bd-0263722bef28 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:57:12.095678 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "db55f42f-05ed-4dc7-b257-7b4db83cdc96", "name": "network-vif-deleted", "tag": "258c1e08-d909-4040-b201-a64fbd6f41cd", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:57:12.096094 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b37024ca-77ea-4a04-a4bd-0263722bef28 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:57:12.096343 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'db55f42f-05ed-4dc7-b257-7b4db83cdc96', 'name': 'network-vif-deleted', 'tag': '258c1e08-d909-4040-b201-a64fbd6f41cd', 'status': 'completed', 'code': 200} Nov 12 14:57:12.648025 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa01a86-8cfc-4d0e-aa0f-84379f5abf6a req-9dea2089-bbe5-4654-a60a-1b909284123e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:12.649671 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cfa01a86-8cfc-4d0e-aa0f-84379f5abf6a req-9dea2089-bbe5-4654-a60a-1b909284123e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0805686 Nov 12 14:57:12.708836 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cfa01a86-8cfc-4d0e-aa0f-84379f5abf6a req-f768fccc-8835-4e31-9fea-cbee6673f746 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498807 Nov 12 14:57:13.284899 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-95eff554-4e73-4399-b981-3a2413ed6691 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:13.286262 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-95eff554-4e73-4399-b981-3a2413ed6691 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/networks?id=6ec68ee4-86ea-4750-8c5b-ad6204b38664 HTTP/1.1" status: 200 len: 809 time: 0.0994112 Nov 12 14:57:13.300584 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-a70e7b9b-4b79-4d46-a4bc-6ecc1e36f60d tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/quotas/541f7684cc1c484fb8cde1d45d8b538e HTTP/1.1" status: 200 len: 375 time: 0.0087855 Nov 12 14:57:13.331062 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-42ed9365-71f9-4174-9819-aa7748a3c374 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=541f7684cc1c484fb8cde1d45d8b538e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0253055 Nov 12 14:57:13.429556 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-81fbed33-c7a4-41c0-ba54-74eb8d1b6398 service neutron] 10.222.0.61 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0914240 Nov 12 14:57:13.516805 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-33feddb9-3e3f-4f78-9e14-5d630f15eb03 service neutron] 10.222.0.61 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812914 Nov 12 14:57:13.676294 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-17910bca-02a1-4539-be62-e5d175a5a232 req-de6e8151-70f8-4cd1-b8cd-5d488a8ee049 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 210 time: 0.0323126 Nov 12 14:57:13.829294 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227e00bc-a6ad-46c6-aa9d-57dccb7062a6 req-f5fffa61-3a0e-4c15-9e50-b6a13a41617a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:13.830752 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-227e00bc-a6ad-46c6-aa9d-57dccb7062a6 req-f5fffa61-3a0e-4c15-9e50-b6a13a41617a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0524945 Nov 12 14:57:13.877082 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-227e00bc-a6ad-46c6-aa9d-57dccb7062a6 req-80fbdb3e-10e5-44d4-8dd5-d216cab77a04 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401180 Nov 12 14:57:14.767084 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-59ccc39d-626c-4ede-a848-25d4275fb663 req-816dbfe3-f7d5-47d1-a13f-85d829138380 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 210 time: 0.0254142 Nov 12 14:57:14.989263 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fa01959-a2e8-48b8-ad4d-de9c266b6f95 req-10856e3f-2a1f-4bc9-9905-5fc795899a28 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:14.990690 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2fa01959-a2e8-48b8-ad4d-de9c266b6f95 req-10856e3f-2a1f-4bc9-9905-5fc795899a28 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0476117 Nov 12 14:57:15.039334 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2fa01959-a2e8-48b8-ad4d-de9c266b6f95 req-8e6b9213-b95e-4246-a37f-037da9fe49cf tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427198 Nov 12 14:57:15.650198 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 258c1e08-d909-4040-b201-a64fbd6f41cd no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:57:15.673580 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 258c1e08-d909-4040-b201-a64fbd6f41cd {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:57:15.673921 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 258c1e08-d909-4040-b201-a64fbd6f41cd not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:57:15.867767 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-84a7c7d6-477a-4215-8400-fb1631a51ba6 req-d2ffc648-d72a-4be1-ae0e-b59a353012c4 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 210 time: 0.0331686 Nov 12 14:57:16.159793 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa916823-11f9-41fc-92a6-2335706c0cba req-426b2500-e81f-470c-a591-bf8ba40f8a56 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:16.161286 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fa916823-11f9-41fc-92a6-2335706c0cba req-426b2500-e81f-470c-a591-bf8ba40f8a56 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0527740 Nov 12 14:57:16.211306 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fa916823-11f9-41fc-92a6-2335706c0cba req-5eda9aab-186c-4626-90ce-8773340af6d4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439227 Nov 12 14:57:16.467114 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-03a16fa5-e5a3-4139-a09e-28959461039f tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:16.468620 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-03a16fa5-e5a3-4139-a09e-28959461039f tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.86 "GET /v2.0/networks?id=6ec68ee4-86ea-4750-8c5b-ad6204b38664 HTTP/1.1" status: 200 len: 809 time: 0.1103337 Nov 12 14:57:16.483407 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Request body: {'port': {'device_id': '487d9e52-ba05-4e93-86a2-7394a9312123', 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664', 'admin_state_up': True, 'tenant_id': '541f7684cc1c484fb8cde1d45d8b538e'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:57:16.625245 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Made reservation on behalf of 541f7684cc1c484fb8cde1d45d8b538e for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:57:16.629160 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:16.777726 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Allocated IP 172.20.0.3 (6ec68ee4-86ea-4750-8c5b-ad6204b38664/91f83bd1-9576-4d8f-9a67-268c7bf31499/f982bdc0-1781-4f6f-a117-a07b4b16cc65) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:57:16.952515 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:16.993119 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-efaa982a-ebe1-4bbf-8575-6f0b7ecadb2f req-0f66deef-21a0-4483-8854-269f42f6424d tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 210 time: 0.0384104 Nov 12 14:57:17.017547 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:17.063602 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:57:17.066683 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:57:17.072612 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:57:17.078689 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:17.079332 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:17.090193 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Pushing event updated for resources: {'Port': ['ID=f982bdc0-1781-4f6f-a117-a07b4b16cc65,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:17.103849 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89741163-56e8-440b-8f12-9ffaf78e8c9c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6248395 Nov 12 14:57:17.120560 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Request body: {'port': {'device_id': '487d9e52-ba05-4e93-86a2-7394a9312123', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:57:17.179647 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:17.332409 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cadc1756-5aac-4fac-b99b-7b6311effafc req-ec68a48c-e476-45ed-b56f-037ad8a0a7fb tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:17.333828 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cadc1756-5aac-4fac-b99b-7b6311effafc req-ec68a48c-e476-45ed-b56f-037ad8a0a7fb tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0497506 Nov 12 14:57:17.381790 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cadc1756-5aac-4fac-b99b-7b6311effafc req-cb2fab3b-2a58-4672-8cab-0a42ae7f0e6d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419104 Nov 12 14:57:17.453800 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f982bdc0-1781-4f6f-a117-a07b4b16cc65 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:57:17.462702 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:17.475682 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Transition to ACTIVE for port object f982bdc0-1781-4f6f-a117-a07b4b16cc65 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:57:17.479597 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:17.555514 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Pushing event updated for resources: {'Port': ['ID=f982bdc0-1781-4f6f-a117-a07b4b16cc65,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:17.570193 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Attempting to bind port f982bdc0-1781-4f6f-a117-a07b4b16cc65 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:57:17.570526 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Attempting to bind port f982bdc0-1781-4f6f-a117-a07b4b16cc65 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '3e64eb13-260c-404a-8e4f-19728a3fbcf8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:57:17.570847 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Attempting to bind port f982bdc0-1781-4f6f-a117-a07b4b16cc65 on network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:57:17.576350 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Port f982bdc0-1781-4f6f-a117-a07b4b16cc65 on network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:57:17.576669 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Attempting to bind port f982bdc0-1781-4f6f-a117-a07b4b16cc65 on network 6ec68ee4-86ea-4750-8c5b-ad6204b38664 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:57:17.581783 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 57, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:57:17.582122 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Checking segment: {'id': '3e64eb13-260c-404a-8e4f-19728a3fbcf8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:57:17.582504 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Bound using segment: {'id': '3e64eb13-260c-404a-8e4f-19728a3fbcf8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:57:17.582922 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Bound port: f982bdc0-1781-4f6f-a117-a07b4b16cc65, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3e64eb13-260c-404a-8e4f-19728a3fbcf8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 601, 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:57:17.583270 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:17.660331 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] For port f982bdc0-1781-4f6f-a117-a07b4b16cc65, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:57:17.664205 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] For port f982bdc0-1781-4f6f-a117-a07b4b16cc65, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=f982bdc0-1781-4f6f-a117-a07b4b16cc65,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:57:17.669248 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:17.705122 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:17.705765 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:17.707816 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] 10.222.0.86 "PUT /v2.0/ports/f982bdc0-1781-4f6f-a117-a07b4b16cc65 HTTP/1.1" status: 200 len: 1093 time: 0.5915794 Nov 12 14:57:17.708273 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '487d9e52-ba05-4e93-86a2-7394a9312123', 'tag': 'f982bdc0-1781-4f6f-a117-a07b4b16cc65'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:57:17.710537 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10263125-7b29-4697-9b01-1530a71e2a05" -d '{"events": [{"name": "network-changed", "server_uuid": "487d9e52-ba05-4e93-86a2-7394a9312123", "tag": "f982bdc0-1781-4f6f-a117-a07b4b16cc65"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:57:17.766017 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0670bf6f-f53a-4ea6-8d83-5c9f7a9784f2 service neutron] Pushing event updated for resources: {'Port': ['ID=f982bdc0-1781-4f6f-a117-a07b4b16cc65,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:17.769747 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:57:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b2f661cc-20ba-4aef-852f-0a58c8a78b04 x-openstack-request-id: req-b2f661cc-20ba-4aef-852f-0a58c8a78b04 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:57:17.769983 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "487d9e52-ba05-4e93-86a2-7394a9312123", "tag": "f982bdc0-1781-4f6f-a117-a07b4b16cc65", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:57:17.770238 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b2f661cc-20ba-4aef-852f-0a58c8a78b04 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:57:17.772996 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '487d9e52-ba05-4e93-86a2-7394a9312123', 'tag': 'f982bdc0-1781-4f6f-a117-a07b4b16cc65', 'status': 'completed', 'code': 200} Nov 12 14:57:17.791448 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9196228-8d61-40d7-9bb7-e34fec0082af req-4ef2f152-2c9a-42d1-b855-1dd1f9f24d7c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:17.794093 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f9196228-8d61-40d7-9bb7-e34fec0082af req-4ef2f152-2c9a-42d1-b855-1dd1f9f24d7c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1048794 Nov 12 14:57:17.848181 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-31cdbc90-a149-498d-9cd7-ca759932f13d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:17.850596 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-31cdbc90-a149-498d-9cd7-ca759932f13d service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=541f7684cc1c484fb8cde1d45d8b538e&device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 1096 time: 0.0634866 Nov 12 14:57:17.878190 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f9196228-8d61-40d7-9bb7-e34fec0082af req-fb761b33-5e48-4de8-9ade-62ba75e0bf59 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0698252 Nov 12 14:57:17.906420 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-7899f1da-265a-42ee-99e5-8f664aab99e7 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f982bdc0-1781-4f6f-a117-a07b4b16cc65 HTTP/1.1" status: 200 len: 217 time: 0.0448191 Nov 12 14:57:17.970992 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-8906301a-5583-45df-b3d8-034035d4e4f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:17.972495 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-8906301a-5583-45df-b3d8-034035d4e4f5 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=91f83bd1-9576-4d8f-9a67-268c7bf31499 HTTP/1.1" status: 200 len: 849 time: 0.0581295 Nov 12 14:57:18.015554 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-40759114-7186-4fa2-95f6-00a3396acb8f service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6ec68ee4-86ea-4750-8c5b-ad6204b38664&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0265265 Nov 12 14:57:18.196887 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ad9007f-378e-4e56-a7c2-5668f5cb1c15 req-64b86370-5bbc-47aa-ae37-fd2e2e811385 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:18.198410 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0ad9007f-378e-4e56-a7c2-5668f5cb1c15 req-64b86370-5bbc-47aa-ae37-fd2e2e811385 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 943 time: 0.0869205 Nov 12 14:57:18.200536 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-5b839bb1-81f8-44dd-bea1-e859322fda2c service neutron] 10.222.0.86 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1733508 Nov 12 14:57:18.305381 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0ad9007f-378e-4e56-a7c2-5668f5cb1c15 req-c2f8388f-cf3c-4a69-af77-825c0bbb1199 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982635 Nov 12 14:57:18.341211 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3d804a51-b884-4d17-92d6-1b29b52877d9 req-89f0bf4b-7079-400a-b193-715ca3305be0 service neutron] 10.222.0.86 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1186156 Nov 12 14:57:18.433815 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10263125-7b29-4697-9b01-1530a71e2a05 req-58f8c52d-0d64-4b28-8df5-67b74ca3c171 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:18.436663 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10263125-7b29-4697-9b01-1530a71e2a05 req-58f8c52d-0d64-4b28-8df5-67b74ca3c171 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=541f7684cc1c484fb8cde1d45d8b538e&device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 1096 time: 0.0489736 Nov 12 14:57:18.542985 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fded68b-dc52-4fa7-bb5e-08d79ac2ea6d req-86c5c38d-6eed-4121-89bc-b8d56ec4e30a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:18.544798 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5fded68b-dc52-4fa7-bb5e-08d79ac2ea6d req-86c5c38d-6eed-4121-89bc-b8d56ec4e30a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0671329 Nov 12 14:57:18.584314 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10263125-7b29-4697-9b01-1530a71e2a05 req-ec9a9a72-ba2b-4f6e-8593-df93da89139c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:18.584314 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10263125-7b29-4697-9b01-1530a71e2a05 req-ec9a9a72-ba2b-4f6e-8593-df93da89139c service neutron] 10.222.0.86 "GET /v2.0/networks?id=6ec68ee4-86ea-4750-8c5b-ad6204b38664 HTTP/1.1" status: 200 len: 910 time: 0.1364408 Nov 12 14:57:18.603921 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5fded68b-dc52-4fa7-bb5e-08d79ac2ea6d req-80c3edcf-42af-46a6-be52-ae9c47e43175 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526342 Nov 12 14:57:18.634577 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10263125-7b29-4697-9b01-1530a71e2a05 req-b4bafb32-9e49-4afa-8776-94f941896f02 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=f982bdc0-1781-4f6f-a117-a07b4b16cc65 HTTP/1.1" status: 200 len: 217 time: 0.0439966 Nov 12 14:57:18.689109 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10263125-7b29-4697-9b01-1530a71e2a05 req-a8973f1c-6a3a-4937-8219-5234f7829590 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:18.690563 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10263125-7b29-4697-9b01-1530a71e2a05 req-a8973f1c-6a3a-4937-8219-5234f7829590 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=91f83bd1-9576-4d8f-9a67-268c7bf31499 HTTP/1.1" status: 200 len: 849 time: 0.0453577 Nov 12 14:57:18.722855 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10263125-7b29-4697-9b01-1530a71e2a05 req-27f62b84-95d2-4ba3-9e7e-6f85fd7c26ba service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6ec68ee4-86ea-4750-8c5b-ad6204b38664&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0245709 Nov 12 14:57:18.818315 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10263125-7b29-4697-9b01-1530a71e2a05 req-869dad30-4f0b-4242-b9fa-582efa2166a5 service neutron] 10.222.0.86 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846462 Nov 12 14:57:18.918741 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-10263125-7b29-4697-9b01-1530a71e2a05 req-42e07cd6-f078-41f2-a07c-4c4529437897 service neutron] 10.222.0.86 "GET /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882304 Nov 12 14:57:19.017487 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a50005c6-0032-4f1d-b049-f43b8831ad7f req-1a8c006e-fc52-4de5-8725-3b16cb2484db tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:19.019025 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a50005c6-0032-4f1d-b049-f43b8831ad7f req-1a8c006e-fc52-4de5-8725-3b16cb2484db tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0568006 Nov 12 14:57:19.069130 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a50005c6-0032-4f1d-b049-f43b8831ad7f req-32be4256-da82-4e53-b7c3-f7c27716fe0a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435479 Nov 12 14:57:19.562199 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8562d0ac-508c-45ea-a59f-39ee7cbda2eb req-2d6067d5-87c6-4b4a-902c-754aa5223470 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:19.563668 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8562d0ac-508c-45ea-a59f-39ee7cbda2eb req-2d6067d5-87c6-4b4a-902c-754aa5223470 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 943 time: 0.0507176 Nov 12 14:57:19.615767 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8562d0ac-508c-45ea-a59f-39ee7cbda2eb req-2ac76f51-f7f8-45f2-aa82-e698876380cc tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461383 Nov 12 14:57:19.734109 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b6d03b-a8b0-46cc-8760-9571205687c8 req-06528fcc-9070-47b4-94e1-32997065d32a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:19.735601 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-73b6d03b-a8b0-46cc-8760-9571205687c8 req-06528fcc-9070-47b4-94e1-32997065d32a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0578678 Nov 12 14:57:19.789270 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-73b6d03b-a8b0-46cc-8760-9571205687c8 req-b1bbafb6-d62e-4ca9-a52a-ee7d9aca371f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457525 Nov 12 14:57:19.818308 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4c5edc-766f-462a-9cf6-a70263cbc579 req-eb87dd05-61fa-403a-9d9f-eaea9b57b3a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:19.819814 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ba4c5edc-766f-462a-9cf6-a70263cbc579 req-eb87dd05-61fa-403a-9d9f-eaea9b57b3a3 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1098 time: 0.0549560 Nov 12 14:57:19.872574 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ba4c5edc-766f-462a-9cf6-a70263cbc579 req-168e4ce5-daef-4226-ad06-473dbad2ab01 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384035 Nov 12 14:57:20.197270 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d319d51-5503-4e51-bd1f-b9e502146f9a req-b1b71ba9-3d53-4ffe-a90f-de4ff351a886 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:20.199365 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2d319d51-5503-4e51-bd1f-b9e502146f9a req-b1b71ba9-3d53-4ffe-a90f-de4ff351a886 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0520885 Nov 12 14:57:20.248281 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2d319d51-5503-4e51-bd1f-b9e502146f9a req-5f88a844-63ac-429d-a2d0-2b5f9179e578 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427082 Nov 12 14:57:20.733523 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f740167-e7d8-4648-8551-57bcfa7f67fb req-8b73794c-fed9-4818-b460-05fffc7aa648 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:20.735008 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9f740167-e7d8-4648-8551-57bcfa7f67fb req-8b73794c-fed9-4818-b460-05fffc7aa648 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 943 time: 0.0491133 Nov 12 14:57:20.783680 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9f740167-e7d8-4648-8551-57bcfa7f67fb req-b07d3b4a-0d29-43a9-b661-5ed6631a06fa tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426741 Nov 12 14:57:20.906402 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52ed314-fd4b-4f2e-8062-6139b8cffaa5 req-4f456158-3acc-4536-aed4-1529161d7737 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:20.907833 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f52ed314-fd4b-4f2e-8062-6139b8cffaa5 req-4f456158-3acc-4536-aed4-1529161d7737 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0517192 Nov 12 14:57:21.137581 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f52ed314-fd4b-4f2e-8062-6139b8cffaa5 req-f82975b3-5de3-4f0a-bb2b-1026b05fd53b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2238004 Nov 12 14:57:21.381705 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dc9368-7d27-4bdf-b10b-25d22a9c4b80 req-921b9283-2083-407a-9da2-8cb77c9e61d1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:21.383356 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c8dc9368-7d27-4bdf-b10b-25d22a9c4b80 req-921b9283-2083-407a-9da2-8cb77c9e61d1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0513482 Nov 12 14:57:21.446124 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c8dc9368-7d27-4bdf-b10b-25d22a9c4b80 req-b36f2dbf-26dc-41eb-951d-70b6c02e502c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567908 Nov 12 14:57:21.584003 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 57106) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:21.667429 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device f982bdc0-1781-4f6f-a117-a07b4b16cc65 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:57:21.720510 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fe7bba21-676c-481d-af92-88d4add4a672 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:21.799748 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port f982bdc0-1781-4f6f-a117-a07b4b16cc65, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=f982bdc0-1781-4f6f-a117-a07b4b16cc65,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:57:21.822618 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fe7bba21-676c-481d-af92-88d4add4a672 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:21.835834 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fe7bba21-676c-481d-af92-88d4add4a672 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:21.894151 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-fe7bba21-676c-481d-af92-88d4add4a672 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=ff9eb3a2113940e691bba58592ec6ad6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3088696 Nov 12 14:57:21.896200 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe7bba21-676c-481d-af92-88d4add4a672 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=102a2b9e-c3a8-473d-95c6-ef720c80c880,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:21.897363 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 57120) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:21.973806 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'f982bdc0-1781-4f6f-a117-a07b4b16cc65', 'network_id': '6ec68ee4-86ea-4750-8c5b-ad6204b38664', 'port_id': 'f982bdc0-1781-4f6f-a117-a07b4b16cc65', 'mac_address': 'fa:16:3e:14:d5:ae', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 601, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '91f83bd1-9576-4d8f-9a67-268c7bf31499', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:57:22.017702 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:22.030221 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d5eba0-6e7e-4450-b191-9ffe686f4caf req-5a1f3fd4-d9aa-490f-b089-c1e38808e5c4 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:22.032061 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a8d5eba0-6e7e-4450-b191-9ffe686f4caf req-5a1f3fd4-d9aa-490f-b089-c1e38808e5c4 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 943 time: 0.1065991 Nov 12 14:57:22.032456 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f982bdc0-1781-4f6f-a117-a07b4b16cc65 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:57:22.035752 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4fba222a-baf4-4135-81e5-b99b5992fb9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:22.056585 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port f982bdc0-1781-4f6f-a117-a07b4b16cc65, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=f982bdc0-1781-4f6f-a117-a07b4b16cc65,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:57:22.061620 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:22.082169 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4fba222a-baf4-4135-81e5-b99b5992fb9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:22.120782 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8c1718ad-6524-4cf3-bfe8-947582a61ea7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:22.127189 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=f982bdc0-1781-4f6f-a117-a07b4b16cc65,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:22.134636 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.135100 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.135436 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.135766 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.136089 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.136436 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.136759 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.137158 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.137499 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.137821 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.138256 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.138511 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:57:22.140766 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a8d5eba0-6e7e-4450-b191-9ffe686f4caf req-072b692c-dee8-4175-8509-4ff9b89721a3 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936673 Nov 12 14:57:22.174932 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4fba222a-baf4-4135-81e5-b99b5992fb9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:22.178036 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4fba222a-baf4-4135-81e5-b99b5992fb9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:22.181475 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-4fba222a-baf4-4135-81e5-b99b5992fb9d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/102a2b9e-c3a8-473d-95c6-ef720c80c880 HTTP/1.1" status: 204 len: 168 time: 0.2798474 Nov 12 14:57:22.192330 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fba222a-baf4-4135-81e5-b99b5992fb9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=102a2b9e-c3a8-473d-95c6-ef720c80c880,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:22.268286 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fec3c5-41b6-45a2-8bec-ae074a6f472d req-0bf18ba9-044b-48a5-b460-5b5588546e69 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:22.269910 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-78fec3c5-41b6-45a2-8bec-ae074a6f472d req-0bf18ba9-044b-48a5-b460-5b5588546e69 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0575716 Nov 12 14:57:22.329822 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-78fec3c5-41b6-45a2-8bec-ae074a6f472d req-3f926e24-bbe3-402b-92c9-2d2332dce4ad tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508981 Nov 12 14:57:22.492529 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['f982bdc0-1781-4f6f-a117-a07b4b16cc65'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:57:22.632637 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1abaf36-5a33-4043-9192-b4608c276c48 req-7d6a3b0b-79f0-4819-acc4-a649e08521a9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:22.634640 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d1abaf36-5a33-4043-9192-b4608c276c48 req-7d6a3b0b-79f0-4819-acc4-a649e08521a9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0861447 Nov 12 14:57:22.695445 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d1abaf36-5a33-4043-9192-b4608c276c48 req-06011cba-4983-405d-8676-98f2053e906c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509429 Nov 12 14:57:22.912129 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-30660e01-7cf8-4eba-95f0-ddd405fc6ab1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:22.913615 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-30660e01-7cf8-4eba-95f0-ddd405fc6ab1 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1098 time: 0.3169389 Nov 12 14:57:22.925258 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6e2994-de0c-4a96-a88c-21b627e65241 req-e45fd3e9-52dc-4e8a-b3f7-7be8d0daf79f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:22.926808 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9d6e2994-de0c-4a96-a88c-21b627e65241 req-e45fd3e9-52dc-4e8a-b3f7-7be8d0daf79f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.3325262 Nov 12 14:57:23.034625 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9d6e2994-de0c-4a96-a88c-21b627e65241 req-3909b21d-2b4a-4167-9785-0a8ba2ca8455 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981765 Nov 12 14:57:23.059700 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-42d84dd4-0947-4f93-8216-c1e60310fc6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:23.061202 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-42d84dd4-0947-4f93-8216-c1e60310fc6c service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 919 time: 0.1335318 Nov 12 14:57:23.111773 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-b71d213e-a73e-4759-b8e7-bcb01fc65bbd service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18 HTTP/1.1" status: 200 len: 217 time: 0.0356364 Nov 12 14:57:23.170906 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-ee32cd73-c670-4d17-83ba-7443fba973e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:23.172825 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-ee32cd73-c670-4d17-83ba-7443fba973e0 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 200 len: 858 time: 0.0472176 Nov 12 14:57:23.213837 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-6b86786d-bad1-4558-b949-199ffbeac766 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0266285 Nov 12 14:57:23.280247 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a38e16ad-1711-4932-bc4e-498a38cf62ff req-5f7212b5-23a3-419f-ae3d-4548339997c9 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:23.281778 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a38e16ad-1711-4932-bc4e-498a38cf62ff req-5f7212b5-23a3-419f-ae3d-4548339997c9 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 944 time: 0.0555694 Nov 12 14:57:23.349237 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-1a3be7bb-158a-49f8-b665-7432cac078da service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1149709 Nov 12 14:57:23.351862 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a38e16ad-1711-4932-bc4e-498a38cf62ff req-8566aa94-6958-4345-90b3-4c9651c8db2c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551622 Nov 12 14:57:23.444732 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6d1f7765-e5ca-4e8d-827b-e219e2184da4 req-c7934f35-cb1e-44a3-8d3d-abc68301389d service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871403 Nov 12 14:57:23.686631 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device f982bdc0-1781-4f6f-a117-a07b4b16cc65 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:57:23.749600 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port f982bdc0-1781-4f6f-a117-a07b4b16cc65 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:57:23.753571 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port f982bdc0-1781-4f6f-a117-a07b4b16cc65 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:57:23.753937 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:23.810082 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67fdf491-6b82-458a-b885-06150b813949 req-0bb967e5-1199-40a9-a8ad-6500ccdeed80 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:23.811617 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-67fdf491-6b82-458a-b885-06150b813949 req-0bb967e5-1199-40a9-a8ad-6500ccdeed80 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0501387 Nov 12 14:57:23.832186 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:23.855986 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '487d9e52-ba05-4e93-86a2-7394a9312123', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f982bdc0-1781-4f6f-a117-a07b4b16cc65'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:57:23.858271 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79dbb004-f522-4bb8-b741-68d609fd245d" -d '{"events": [{"server_uuid": "487d9e52-ba05-4e93-86a2-7394a9312123", "name": "network-vif-plugged", "status": "completed", "tag": "f982bdc0-1781-4f6f-a117-a07b4b16cc65"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:57:23.860833 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-67fdf491-6b82-458a-b885-06150b813949 req-24479094-ba15-48f6-8e89-fd0f1f7e61d5 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421827 Nov 12 14:57:23.871489 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port f982bdc0-1781-4f6f-a117-a07b4b16cc65, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=f982bdc0-1781-4f6f-a117-a07b4b16cc65,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:57:23.876864 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:23.902047 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:57:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6347ce42-e0dd-4e84-83e3-8ab234ce8843 x-openstack-request-id: req-6347ce42-e0dd-4e84-83e3-8ab234ce8843 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:57:23.902358 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "487d9e52-ba05-4e93-86a2-7394a9312123", "name": "network-vif-plugged", "status": "completed", "tag": "f982bdc0-1781-4f6f-a117-a07b4b16cc65", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:57:23.902668 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-6347ce42-e0dd-4e84-83e3-8ab234ce8843 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:57:23.903563 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '487d9e52-ba05-4e93-86a2-7394a9312123', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f982bdc0-1781-4f6f-a117-a07b4b16cc65', 'code': 200} Nov 12 14:57:23.928376 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=f982bdc0-1781-4f6f-a117-a07b4b16cc65,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:24.103244 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be7facd-0aa6-4dca-9abf-77e395f42e2d req-711ad301-2acb-406e-95f8-b91dd06eb6fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:24.104796 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9be7facd-0aa6-4dca-9abf-77e395f42e2d req-711ad301-2acb-406e-95f8-b91dd06eb6fc service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 1098 time: 0.0444760 Nov 12 14:57:24.150852 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e83e9c-0b69-46d2-93fd-4daf4dff2b63 req-d7df2b4b-c28f-4549-8a43-a90f12ab44de tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:24.152357 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-62e83e9c-0b69-46d2-93fd-4daf4dff2b63 req-d7df2b4b-c28f-4549-8a43-a90f12ab44de tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0500762 Nov 12 14:57:24.157392 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9be7facd-0aa6-4dca-9abf-77e395f42e2d req-970383ce-e2e4-4eeb-ac42-e32b27bec14c service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393353 Nov 12 14:57:24.203667 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-62e83e9c-0b69-46d2-93fd-4daf4dff2b63 req-c41817f0-ca00-41a4-ade3-3f4614b0adfb tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453229 Nov 12 14:57:24.476297 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9cfbd5-0191-462e-9303-568dd91a48cd req-1009d574-8469-41ef-9186-e0e4294f9883 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:24.477829 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6f9cfbd5-0191-462e-9303-568dd91a48cd req-1009d574-8469-41ef-9186-e0e4294f9883 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 945 time: 0.0559523 Nov 12 14:57:24.525697 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-64f655fa-4a6f-413d-8370-285074a92098 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:24.534114 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6f9cfbd5-0191-462e-9303-568dd91a48cd req-97a1da61-a30f-4582-b2d4-d7eda0d7af3e tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497253 Nov 12 14:57:24.985865 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1907de5a-1b57-4ee5-8879-065111bef45e req-f8cc71a5-c3fd-4d62-927a-b0aca58dc922 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:24.987483 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1907de5a-1b57-4ee5-8879-065111bef45e req-f8cc71a5-c3fd-4d62-927a-b0aca58dc922 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0547557 Nov 12 14:57:25.036938 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1907de5a-1b57-4ee5-8879-065111bef45e req-688317ca-d156-4243-8553-46080b345085 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434368 Nov 12 14:57:25.336638 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5a802d-de9d-447b-bf43-2f943503b2a8 req-4a67bb71-f9ea-4f93-ae76-d474fa7c1ebe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:25.338174 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2e5a802d-de9d-447b-bf43-2f943503b2a8 req-4a67bb71-f9ea-4f93-ae76-d474fa7c1ebe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0525658 Nov 12 14:57:25.391182 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2e5a802d-de9d-447b-bf43-2f943503b2a8 req-461fefc3-50bf-4f55-aa01-135763bd7171 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459557 Nov 12 14:57:25.515658 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:25.659785 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19b3ce3f-e690-4cb8-8bf3-ffbbf7298e76 req-89ee2df2-fabd-4148-be58-71bdad597257 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:25.661448 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-19b3ce3f-e690-4cb8-8bf3-ffbbf7298e76 req-89ee2df2-fabd-4148-be58-71bdad597257 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 945 time: 0.0544128 Nov 12 14:57:25.694474 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 57218) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:25.715426 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-19b3ce3f-e690-4cb8-8bf3-ffbbf7298e76 req-0ce869f8-03ae-49d6-83ff-ab68b8d1157e tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462320 Nov 12 14:57:25.875927 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-372711c8-5422-4f25-b1bf-948083f4677a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:25.970793 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-372711c8-5422-4f25-b1bf-948083f4677a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:25.976412 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-372711c8-5422-4f25-b1bf-948083f4677a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:26.018170 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-372711c8-5422-4f25-b1bf-948083f4677a admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=f730a0b698de464db4a05d52eda76797&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3222313 Nov 12 14:57:26.022743 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 57230) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:26.031340 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-372711c8-5422-4f25-b1bf-948083f4677a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c7fec80-4aa9-4998-83a2-d02512847445,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:26.093147 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e078d45b-dab7-45e6-ac17-ae04d6820776 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:26.124549 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e078d45b-dab7-45e6-ac17-ae04d6820776 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:26.186710 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e078d45b-dab7-45e6-ac17-ae04d6820776 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:26.189951 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e078d45b-dab7-45e6-ac17-ae04d6820776 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:26.192232 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e078d45b-dab7-45e6-ac17-ae04d6820776 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/5c7fec80-4aa9-4998-83a2-d02512847445 HTTP/1.1" status: 204 len: 168 time: 0.1681058 Nov 12 14:57:26.197915 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ac956da-fdfd-4784-b2d7-1832fccf68cf req-7d3d70e3-51b7-49e4-ab55-0e4f6ccb810b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:26.199956 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7ac956da-fdfd-4784-b2d7-1832fccf68cf req-7d3d70e3-51b7-49e4-ab55-0e4f6ccb810b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0535660 Nov 12 14:57:26.204581 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e078d45b-dab7-45e6-ac17-ae04d6820776 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c7fec80-4aa9-4998-83a2-d02512847445,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:26.255418 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7ac956da-fdfd-4784-b2d7-1832fccf68cf req-ac207b97-d53a-483d-9a00-4901d8dfd4b2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484433 Nov 12 14:57:26.536378 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b587b361-ea83-4293-823d-190af21b6942 req-fd088eef-57fc-43c2-94d1-1128d93876a1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:26.538119 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b587b361-ea83-4293-823d-190af21b6942 req-fd088eef-57fc-43c2-94d1-1128d93876a1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0598021 Nov 12 14:57:26.594950 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b587b361-ea83-4293-823d-190af21b6942 req-e92f0c49-30d9-4e18-baf5-0a1b4ae0d5af tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495617 Nov 12 14:57:26.835988 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9112a784-1b31-4ea2-96ff-cf5f34f530a7 req-fbe262f6-a35e-4964-97a7-700891375cc8 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:26.837522 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9112a784-1b31-4ea2-96ff-cf5f34f530a7 req-fbe262f6-a35e-4964-97a7-700891375cc8 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 945 time: 0.0525475 Nov 12 14:57:26.892709 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9112a784-1b31-4ea2-96ff-cf5f34f530a7 req-1e448c22-4e40-454d-bb64-50a03c83eb5b tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451543 Nov 12 14:57:26.910952 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:26.934586 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 57264) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:27.047272 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1216951722-network', 'tenant_id': '71f7babcbb2e48a899f3b931fbcb2c03'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:57:27.073523 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Made reservation on behalf of 71f7babcbb2e48a899f3b931fbcb2c03 for: {'network': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:57:27.075890 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.084991 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.199730 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.204322 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.227906 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 609} {{(pid=101617) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:57:27.251531 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.251883 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.segments_db [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Added segment 8d885094-f225-46f0-a8f7-af9d90c9da56 of type vlan for network 52b14bae-7f5f-4554-a082-87deb1ef1096 Nov 12 14:57:27.253215 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74f530ff-ef50-475b-b409-b28efb99f0d0,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:27.302146 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.328478 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.329733 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:27.330422 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.364837 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.4292302 Nov 12 14:57:27.368374 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 57282) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:57:27.374612 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Request body: {'subnet': {'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1216951722-subnet', 'tenant_id': '71f7babcbb2e48a899f3b931fbcb2c03', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:57:27.386044 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b9967b4-cef5-4968-9cfb-b91129f03d9e req-7d905274-b8df-4857-9d87-a5d50092392b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:27.387607 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b9967b4-cef5-4968-9cfb-b91129f03d9e req-7d905274-b8df-4857-9d87-a5d50092392b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0616925 Nov 12 14:57:27.399569 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27543d00-9b3c-4220-a1b6-867502aa6042 admin admin] Pushing event updated for resources: {'Network': ['ID=52b14bae-7f5f-4554-a082-87deb1ef1096,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:27.412936 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 52b14bae-7f5f-4554-a082-87deb1ef1096 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:57:27.432669 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Made reservation on behalf of 71f7babcbb2e48a899f3b931fbcb2c03 for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:57:27.435801 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Publish callbacks [] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.479795 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b9967b4-cef5-4968-9cfb-b91129f03d9e req-23bfa13d-86b5-4b68-9dd1-7d4b7b4bcb64 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0823858 Nov 12 14:57:27.682494 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.749341 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fece94b6-d7e2-4b0b-8764-500d19754c81 req-e787aa5b-f760-41e4-ac83-f1d220566a99 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:27.750938 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fece94b6-d7e2-4b0b-8764-500d19754c81 req-e787aa5b-f760-41e4-ac83-f1d220566a99 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 945 time: 0.0533519 Nov 12 14:57:27.769523 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e3c6e311-60aa-48d4-9047-fdea4100c035,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:27.791443 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6346d22c-752e-4135-a498-714d6a6b2ee1 req-804694a6-eef7-4901-8913-7c612a0fd43b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:27.793028 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6346d22c-752e-4135-a498-714d6a6b2ee1 req-804694a6-eef7-4901-8913-7c612a0fd43b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.1037061 Nov 12 14:57:27.798913 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Checking segment: {'id': '8d885094-f225-46f0-a8f7-af9d90c9da56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:57:27.799267 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Network hostable DHCP agents. Network: 52b14bae-7f5f-4554-a082-87deb1ef1096, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:57:27.804558 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fece94b6-d7e2-4b0b-8764-500d19754c81 req-5d3aefa2-f2d1-4508-9761-be710a2ff55c tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467284 Nov 12 14:57:27.838483 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Network 52b14bae-7f5f-4554-a082-87deb1ef1096 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:57:27.858927 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 52b14bae-7f5f-4554-a082-87deb1ef1096) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:57:27.864540 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6346d22c-752e-4135-a498-714d6a6b2ee1 req-2e327a93-a3d0-46e4-93fd-76fdb53a1f04 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610657 Nov 12 14:57:27.866802 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:27.867478 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:27.872304 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05690f99-10a4-4e58-8fbd-e33137f9ee13 None None] Network 52b14bae-7f5f-4554-a082-87deb1ef1096 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:57:27.886720 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-93a6a164-1d47-4bca-81b9-5eb743cdc629 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.5172017 Nov 12 14:57:27.950840 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:28.063185 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d172fe8d-24d6-48c7-a598-d6b5c3d80862 None None] Network 52b14bae-7f5f-4554-a082-87deb1ef1096 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:57:28.641710 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81163ef3-9d60-4785-8429-f89ac3def2d7 req-e6fa1187-4e39-4933-a004-724fcea9d62c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:28.643249 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-81163ef3-9d60-4785-8429-f89ac3def2d7 req-e6fa1187-4e39-4933-a004-724fcea9d62c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0712025 Nov 12 14:57:28.695552 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-81163ef3-9d60-4785-8429-f89ac3def2d7 req-9a78d1b0-3cb3-445e-b175-79c8a2b5e85c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456080 Nov 12 14:57:28.930052 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abd50d9-7ec9-4d19-9f6b-c33e5d9df23d req-e624f427-fd54-4303-a7d6-349d5179f043 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:28.931643 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9abd50d9-7ec9-4d19-9f6b-c33e5d9df23d req-e624f427-fd54-4303-a7d6-349d5179f043 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 945 time: 0.0535877 Nov 12 14:57:28.979742 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9abd50d9-7ec9-4d19-9f6b-c33e5d9df23d req-69bb3ca8-7b59-43c5-adf5-ddb1383db309 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421164 Nov 12 14:57:29.409967 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f119a03-802f-454c-8a2a-e8f4dcf3fdd5 req-27b7b539-defb-4e45-80fe-c5df519389e0 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:29.411551 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5f119a03-802f-454c-8a2a-e8f4dcf3fdd5 req-27b7b539-defb-4e45-80fe-c5df519389e0 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0518875 Nov 12 14:57:29.468192 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5f119a03-802f-454c-8a2a-e8f4dcf3fdd5 req-377b4751-02d1-4313-b31f-6bf0ae200dda tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502851 Nov 12 14:57:29.888427 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ff35ab39-4356-4ef7-97e8-5cca874957c2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:29.896866 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ff35ab39-4356-4ef7-97e8-5cca874957c2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/networks?id=52b14bae-7f5f-4554-a082-87deb1ef1096 HTTP/1.1" status: 200 len: 814 time: 0.1961727 Nov 12 14:57:29.913736 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-815b9411-9a3f-4ff9-a626-5518066e19ca tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/quotas/71f7babcbb2e48a899f3b931fbcb2c03 HTTP/1.1" status: 200 len: 375 time: 0.0158305 Nov 12 14:57:29.978758 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-d52e22ac-7a86-4077-9f5c-272826e7e4bb tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=71f7babcbb2e48a899f3b931fbcb2c03&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0637982 Nov 12 14:57:29.984275 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1779620-a490-4f57-aa6d-31d78816990b req-c0d5ac5e-6ac8-48a1-a834-3dd7cdb964b1 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:29.986478 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d1779620-a490-4f57-aa6d-31d78816990b req-c0d5ac5e-6ac8-48a1-a834-3dd7cdb964b1 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.86 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 945 time: 0.0674915 Nov 12 14:57:29.995691 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb25d94-d8bd-4343-bf4a-364bb8dea8fb req-f63eb53b-afd5-40a0-9b7c-41cc012c7954 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:30.004734 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8bb25d94-d8bd-4343-bf4a-364bb8dea8fb req-f63eb53b-afd5-40a0-9b7c-41cc012c7954 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1272311 Nov 12 14:57:30.125685 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8bb25d94-d8bd-4343-bf4a-364bb8dea8fb req-a77d411f-ccda-461e-a2aa-f5e689c7c77f tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1195884 Nov 12 14:57:30.172025 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-d1779620-a490-4f57-aa6d-31d78816990b req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Deleting port f982bdc0-1781-4f6f-a117-a07b4b16cc65 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:57:30.172643 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d1779620-a490-4f57-aa6d-31d78816990b req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:30.173336 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-1134ea2f-a317-4bd2-b637-acd596585125 service neutron] 10.222.0.61 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1860764 Nov 12 14:57:30.285337 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-f77aa663-55a5-4908-bd47-495f0961222c service neutron] 10.222.0.61 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1034944 Nov 12 14:57:30.309591 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e615fe6b-b1a3-43fc-ab63-f0a6376c9d24 req-96917706-7ffc-4a58-92c7-284639075e20 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:30.312718 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e615fe6b-b1a3-43fc-ab63-f0a6376c9d24 req-96917706-7ffc-4a58-92c7-284639075e20 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 945 time: 0.1039429 Nov 12 14:57:30.327117 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-d1779620-a490-4f57-aa6d-31d78816990b req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] For port f982bdc0-1781-4f6f-a117-a07b4b16cc65, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=f982bdc0-1781-4f6f-a117-a07b4b16cc65,segment=NetworkSegment(3e64eb13-260c-404a-8e4f-19728a3fbcf8),segment_id=3e64eb13-260c-404a-8e4f-19728a3fbcf8)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:57:30.327479 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d1779620-a490-4f57-aa6d-31d78816990b req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:30.356298 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-d1779620-a490-4f57-aa6d-31d78816990b req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Calling delete_port for f982bdc0-1781-4f6f-a117-a07b4b16cc65 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:57:30.436984 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e615fe6b-b1a3-43fc-ab63-f0a6376c9d24 req-3ec8abc3-e2e2-4e60-b8b8-e949e6a65d9d tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/security-groups?id=e4fdb723-2bdc-45bd-81eb-e565bc5a9095&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1087730 Nov 12 14:57:30.540650 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-eea96162-d054-481a-aeee-263b24eeaff6 req-1f7513ef-2386-46bf-8e98-7495d41eb835 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0535815 Nov 12 14:57:30.564097 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d1779620-a490-4f57-aa6d-31d78816990b req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:30.577816 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['f982bdc0-1781-4f6f-a117-a07b4b16cc65'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:57:30.597376 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Pushing event deleted for resources: {'Port': ['ID=f982bdc0-1781-4f6f-a117-a07b4b16cc65,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:30.641548 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-d1779620-a490-4f57-aa6d-31d78816990b req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] No DVR routers for this DVR port f982bdc0-1781-4f6f-a117-a07b4b16cc65 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 14:57:30.644282 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d1779620-a490-4f57-aa6d-31d78816990b req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:30.648070 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d1779620-a490-4f57-aa6d-31d78816990b req-2f5c8f3f-b3b6-4cb0-8613-95d6b350eca2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.86 "DELETE /v2.0/ports/f982bdc0-1781-4f6f-a117-a07b4b16cc65 HTTP/1.1" status: 204 len: 173 time: 0.6408877 Nov 12 14:57:30.648528 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '487d9e52-ba05-4e93-86a2-7394a9312123', 'name': 'network-vif-deleted', 'tag': 'f982bdc0-1781-4f6f-a117-a07b4b16cc65'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:57:30.650759 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25af7c18-4508-4acc-98b3-2c00ce2190dc" -d '{"events": [{"server_uuid": "487d9e52-ba05-4e93-86a2-7394a9312123", "name": "network-vif-deleted", "tag": "f982bdc0-1781-4f6f-a117-a07b4b16cc65"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:57:30.841306 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:57:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-608f3eae-dc54-4fb3-9c94-d64bfe8d7f69 x-openstack-request-id: req-608f3eae-dc54-4fb3-9c94-d64bfe8d7f69 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:57:30.841601 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "487d9e52-ba05-4e93-86a2-7394a9312123", "name": "network-vif-deleted", "tag": "f982bdc0-1781-4f6f-a117-a07b4b16cc65", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:57:30.841840 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-608f3eae-dc54-4fb3-9c94-d64bfe8d7f69 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:57:30.842243 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '487d9e52-ba05-4e93-86a2-7394a9312123', 'name': 'network-vif-deleted', 'tag': 'f982bdc0-1781-4f6f-a117-a07b4b16cc65', 'status': 'completed', 'code': 200} Nov 12 14:57:31.242245 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c98122d-e741-4805-b8c5-9873301c89bd req-9fa3d352-dc00-43fa-b0d7-919f737684ea tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:31.243755 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c98122d-e741-4805-b8c5-9873301c89bd req-9fa3d352-dc00-43fa-b0d7-919f737684ea tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0504768 Nov 12 14:57:31.298613 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c98122d-e741-4805-b8c5-9873301c89bd req-ffb5dcf5-af94-4c57-a8ee-a647a3a8b18b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479550 Nov 12 14:57:31.537603 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ffa1ea4b-0b71-437e-b611-421a96914d6b req-92b9a723-2941-4dab-9afb-0fb2b2d673f4 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 210 time: 0.0308912 Nov 12 14:57:31.633050 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-219e2747-070c-4c54-98ac-f3fee253c158 req-912eb9a6-5233-40ee-bf55-8ea3cc55cd4c tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0261652 Nov 12 14:57:32.416889 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26671eb1-b80c-476b-8d8c-9a20be9cb107 req-ecc6951c-1b18-4d4c-b539-800a61c0a2ba tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:32.418410 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-26671eb1-b80c-476b-8d8c-9a20be9cb107 req-ecc6951c-1b18-4d4c-b539-800a61c0a2ba tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0509033 Nov 12 14:57:32.467682 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-26671eb1-b80c-476b-8d8c-9a20be9cb107 req-6a0ed8be-f069-47dc-8ddc-5a072c72b005 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430868 Nov 12 14:57:32.630442 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4794d549-ee4b-4287-b3f7-1a6abbb7b2da req-9675377c-cc3a-4767-946b-799f97609ac2 tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 210 time: 0.0267985 Nov 12 14:57:32.729121 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-335d1537-ed31-4814-86d7-4982ca0207d4 req-445da94a-7c7d-4dc8-9bdf-98d7513b2b2b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0295496 Nov 12 14:57:33.589986 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e8773eb-9c7e-4fc2-a2a4-cf305aa2388b req-48e9779d-2e87-4e37-9da7-1647a212524a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:33.591487 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5e8773eb-9c7e-4fc2-a2a4-cf305aa2388b req-48e9779d-2e87-4e37-9da7-1647a212524a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0527806 Nov 12 14:57:33.641291 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5e8773eb-9c7e-4fc2-a2a4-cf305aa2388b req-f1d09a12-4e93-4518-9cea-9c4c486c49c6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437279 Nov 12 14:57:33.746977 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d41e4175-6034-41fc-bd15-d3f13a70e6df req-ec7e3de5-db49-49d4-b0a4-1973ec1c29fe tempest-VolumesActionsTest-1725336476 tempest-VolumesActionsTest-1725336476-project] 10.222.0.61 "GET /v2.0/ports?device_id=487d9e52-ba05-4e93-86a2-7394a9312123 HTTP/1.1" status: 200 len: 210 time: 0.0320663 Nov 12 14:57:33.826529 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3b53ae89-e092-4e94-9a11-6c07f66519e7 req-94444c3c-aedb-40e1-a4f8-3f65345d0763 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0268099 Nov 12 14:57:34.572305 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-f46ea8ac-1bd1-410a-bcbf-5b8f1660c146 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:34.574478 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-f46ea8ac-1bd1-410a-bcbf-5b8f1660c146 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.86 "GET /v2.0/networks?id=52b14bae-7f5f-4554-a082-87deb1ef1096 HTTP/1.1" status: 200 len: 814 time: 0.1400950 Nov 12 14:57:34.594942 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Request body: {'port': {'device_id': 'ef1c882c-ba88-4910-9c4d-c9bf784a916e', 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096', 'admin_state_up': True, 'tenant_id': '71f7babcbb2e48a899f3b931fbcb2c03'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:57:34.742642 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Made reservation on behalf of 71f7babcbb2e48a899f3b931fbcb2c03 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:57:34.746834 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:34.792846 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f36f13c2-eb52-41c3-b783-956b1e2f818e req-87f9e9ce-d3d8-4fea-b6b6-e3dff5390b73 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:34.794595 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f36f13c2-eb52-41c3-b783-956b1e2f818e req-87f9e9ce-d3d8-4fea-b6b6-e3dff5390b73 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0668907 Nov 12 14:57:34.863973 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f36f13c2-eb52-41c3-b783-956b1e2f818e req-233f1620-de31-4568-ba8e-8b4e450095e1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0598824 Nov 12 14:57:34.942522 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:34.980831 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4edc7b14-3bbe-457a-8aba-93f418b79190 req-8f0dec59-413f-468d-8fb4-d913ac2a7848 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0529559 Nov 12 14:57:34.995422 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Allocated IP 172.20.0.8 (52b14bae-7f5f-4554-a082-87deb1ef1096/e3c6e311-60aa-48d4-9047-fdea4100c035/ceb7b586-44d0-4731-bf8d-973537662c03) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:57:35.235267 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:35.272729 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:35.321929 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Network 52b14bae-7f5f-4554-a082-87deb1ef1096 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:57:35.327903 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:57:35.331841 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:57:35.337792 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:35.338491 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:35.348655 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Pushing event updated for resources: {'Port': ['ID=ceb7b586-44d0-4731-bf8d-973537662c03,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:35.362091 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-704ac7bc-ac17-4876-af83-3ae474e2f716 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7769649 Nov 12 14:57:35.375778 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Request body: {'port': {'device_id': 'ef1c882c-ba88-4910-9c4d-c9bf784a916e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:57:35.436914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:35.762863 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ceb7b586-44d0-4731-bf8d-973537662c03 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:57:35.771450 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:35.786107 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Transition to ACTIVE for port object ceb7b586-44d0-4731-bf8d-973537662c03 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:57:35.791223 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:35.852751 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Pushing event updated for resources: {'Port': ['ID=ceb7b586-44d0-4731-bf8d-973537662c03,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:35.884449 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Attempting to bind port ceb7b586-44d0-4731-bf8d-973537662c03 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:57:35.884777 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Attempting to bind port ceb7b586-44d0-4731-bf8d-973537662c03 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '8d885094-f225-46f0-a8f7-af9d90c9da56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:57:35.885102 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Attempting to bind port ceb7b586-44d0-4731-bf8d-973537662c03 on network 52b14bae-7f5f-4554-a082-87deb1ef1096 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:57:35.889558 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Port ceb7b586-44d0-4731-bf8d-973537662c03 on network 52b14bae-7f5f-4554-a082-87deb1ef1096 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:57:35.889873 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Attempting to bind port ceb7b586-44d0-4731-bf8d-973537662c03 on network 52b14bae-7f5f-4554-a082-87deb1ef1096 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:57:35.897940 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 57, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:57:35.898306 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Checking segment: {'id': '8d885094-f225-46f0-a8f7-af9d90c9da56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:57:35.898688 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Bound using segment: {'id': '8d885094-f225-46f0-a8f7-af9d90c9da56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:57:35.899472 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Bound port: ceb7b586-44d0-4731-bf8d-973537662c03, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8d885094-f225-46f0-a8f7-af9d90c9da56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:57:35.899472 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:35.994478 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] For port ceb7b586-44d0-4731-bf8d-973537662c03, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:57:35.999179 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] For port ceb7b586-44d0-4731-bf8d-973537662c03, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ceb7b586-44d0-4731-bf8d-973537662c03,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:57:36.003723 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:36.053839 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45079f40-12ab-4a4f-81ab-2c41d9cd386c req-5da8ecf4-574a-43a3-9191-1894d03759b1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:36.055502 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-45079f40-12ab-4a4f-81ab-2c41d9cd386c req-5da8ecf4-574a-43a3-9191-1894d03759b1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1085279 Nov 12 14:57:36.061559 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:36.062286 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:36.063789 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] 10.222.0.86 "PUT /v2.0/ports/ceb7b586-44d0-4731-bf8d-973537662c03 HTTP/1.1" status: 200 len: 1093 time: 0.6928523 Nov 12 14:57:36.067542 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ef1c882c-ba88-4910-9c4d-c9bf784a916e', 'tag': 'ceb7b586-44d0-4731-bf8d-973537662c03'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:57:36.069903 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4a2b754-131c-4933-a419-d2ed9df4c551" -d '{"events": [{"name": "network-changed", "server_uuid": "ef1c882c-ba88-4910-9c4d-c9bf784a916e", "tag": "ceb7b586-44d0-4731-bf8d-973537662c03"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:57:36.111280 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebae81b2-77e5-412d-a00c-f72d123aaedf service neutron] Pushing event updated for resources: {'Port': ['ID=ceb7b586-44d0-4731-bf8d-973537662c03,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:36.125466 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d9c8fe-2eee-4546-baab-649955654d77 req-982e478a-1ef0-4106-addd-b5fe4072bbbd tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:36.127068 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-59d9c8fe-2eee-4546-baab-649955654d77 req-982e478a-1ef0-4106-addd-b5fe4072bbbd tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 943 time: 0.0554438 Nov 12 14:57:36.148664 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-45079f40-12ab-4a4f-81ab-2c41d9cd386c req-d974abbf-44d1-4afb-8034-f58c5ca795ea tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0818462 Nov 12 14:57:36.194516 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-59d9c8fe-2eee-4546-baab-649955654d77 req-1dbfea63-cd5e-438e-ac80-1ba0fe9f7430 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597668 Nov 12 14:57:36.222681 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:57:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3fe48ec1-6a17-4d59-9f02-de6baadc4070 x-openstack-request-id: req-3fe48ec1-6a17-4d59-9f02-de6baadc4070 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:57:36.223077 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ef1c882c-ba88-4910-9c4d-c9bf784a916e", "tag": "ceb7b586-44d0-4731-bf8d-973537662c03", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:57:36.223432 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-3fe48ec1-6a17-4d59-9f02-de6baadc4070 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:57:36.223899 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ef1c882c-ba88-4910-9c4d-c9bf784a916e', 'tag': 'ceb7b586-44d0-4731-bf8d-973537662c03', 'status': 'completed', 'code': 200} Nov 12 14:57:37.269768 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c90dd8b-36a1-493f-9fd4-17a1d228c4ec req-e683de9d-96d3-4820-86e2-3387cfe1498f tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:37.271562 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c90dd8b-36a1-493f-9fd4-17a1d228c4ec req-e683de9d-96d3-4820-86e2-3387cfe1498f tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0514853 Nov 12 14:57:37.324927 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c90dd8b-36a1-493f-9fd4-17a1d228c4ec req-28d4e516-2220-4870-b8a6-a07d922d3b69 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471036 Nov 12 14:57:37.443378 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b59a63-19fa-4594-91db-68717f0ba3b8 req-3db664fb-4ccc-4b56-809a-61c5c512f393 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:37.444783 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97b59a63-19fa-4594-91db-68717f0ba3b8 req-3db664fb-4ccc-4b56-809a-61c5c512f393 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 943 time: 0.0548358 Nov 12 14:57:37.492957 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97b59a63-19fa-4594-91db-68717f0ba3b8 req-696b45ed-40f7-49dd-8519-24cbbc346b87 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420840 Nov 12 14:57:37.808542 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device f982bdc0-1781-4f6f-a117-a07b4b16cc65 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:57:37.828852 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: f982bdc0-1781-4f6f-a117-a07b4b16cc65 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:57:37.829189 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device f982bdc0-1781-4f6f-a117-a07b4b16cc65 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:57:38.471121 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093c521b-84dc-490e-b579-f46dc6577bb0 req-7fdf419e-9091-4765-bec2-f2ab0cedac47 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:38.472830 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-093c521b-84dc-490e-b579-f46dc6577bb0 req-7fdf419e-9091-4765-bec2-f2ab0cedac47 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0585649 Nov 12 14:57:38.531151 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-093c521b-84dc-490e-b579-f46dc6577bb0 req-b648e925-3a1b-4566-8e8e-b8cf7266dde9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496798 Nov 12 14:57:38.646043 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4d5e0a9-3ffa-4169-81a5-11ab064be07d req-3399c597-3228-4a17-bd86-d83a68acbae8 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:38.647966 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4d5e0a9-3ffa-4169-81a5-11ab064be07d req-3399c597-3228-4a17-bd86-d83a68acbae8 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 943 time: 0.0531082 Nov 12 14:57:38.706971 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4d5e0a9-3ffa-4169-81a5-11ab064be07d req-6c90c681-d137-420f-9adc-4e4134dbd50a tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520372 Nov 12 14:57:38.930572 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a2b754-131c-4933-a419-d2ed9df4c551 req-d95d442d-7fd3-4f43-a8a8-371d7e5de791 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:38.932381 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f4a2b754-131c-4933-a419-d2ed9df4c551 req-d95d442d-7fd3-4f43-a8a8-371d7e5de791 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=71f7babcbb2e48a899f3b931fbcb2c03&device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 1096 time: 0.0482166 Nov 12 14:57:39.051015 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a2b754-131c-4933-a419-d2ed9df4c551 req-ddbd5827-4f74-430f-a1a8-534993260be7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:39.053520 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f4a2b754-131c-4933-a419-d2ed9df4c551 req-ddbd5827-4f74-430f-a1a8-534993260be7 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=71f7babcbb2e48a899f3b931fbcb2c03&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1077936 Nov 12 14:57:39.197211 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a2b754-131c-4933-a419-d2ed9df4c551 req-39c12357-fe28-47c8-a40f-26524fc15dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:39.199582 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f4a2b754-131c-4933-a419-d2ed9df4c551 req-39c12357-fe28-47c8-a40f-26524fc15dc9 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1348803 Nov 12 14:57:39.302585 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-c6a89f39-7634-43cc-b357-008d07fd22fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:39.304142 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-c6a89f39-7634-43cc-b357-008d07fd22fa service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=71f7babcbb2e48a899f3b931fbcb2c03&device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 1096 time: 0.0446894 Nov 12 14:57:39.356216 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-521d1ef8-8617-4b92-a371-9bbb7cb42306 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=ceb7b586-44d0-4731-bf8d-973537662c03 HTTP/1.1" status: 200 len: 217 time: 0.0404258 Nov 12 14:57:39.423033 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-afc6ee06-9095-416b-b16b-fa61a7772209 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:39.425559 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-afc6ee06-9095-416b-b16b-fa61a7772209 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e3c6e311-60aa-48d4-9047-fdea4100c035 HTTP/1.1" status: 200 len: 854 time: 0.0556371 Nov 12 14:57:39.481952 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-74fa7d49-4dc6-4b32-b773-622995c575d5 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=52b14bae-7f5f-4554-a082-87deb1ef1096&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0474946 Nov 12 14:57:39.616332 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-bb247603-7059-4a7b-b1ea-00f768d08188 service neutron] 10.222.0.86 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1169379 Nov 12 14:57:39.748427 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-653528ad-d4e7-486d-86f1-87b8dbe59b3b req-a2d46506-585c-43ca-a15e-e223f7cf9b43 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:39.750139 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-653528ad-d4e7-486d-86f1-87b8dbe59b3b req-a2d46506-585c-43ca-a15e-e223f7cf9b43 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1177435 Nov 12 14:57:39.787321 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07823c5b-494a-4ff2-a2f9-9929e6d7120f req-f0f0f5f5-8d67-4264-a64d-589dc58d4db8 service neutron] 10.222.0.86 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1629834 Nov 12 14:57:39.828430 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-653528ad-d4e7-486d-86f1-87b8dbe59b3b req-eee8c202-f58f-4efc-8e17-613f99f409f7 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0640843 Nov 12 14:57:39.860149 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2526fc2f-97ff-43bd-b850-d588b223b878 req-c9720b7e-ae9e-41f4-bf3e-85e6d48a173c tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:39.861765 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2526fc2f-97ff-43bd-b850-d588b223b878 req-c9720b7e-ae9e-41f4-bf3e-85e6d48a173c tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 943 time: 0.0681121 Nov 12 14:57:39.913460 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2526fc2f-97ff-43bd-b850-d588b223b878 req-a60413d6-d8f3-4916-a903-e219db2881a3 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454297 Nov 12 14:57:40.064076 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2e0f13-44ae-4f1a-b71e-8162b45f4ead req-dc8b20a3-f58b-4677-8d76-a0c868ca13ab tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:40.066078 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5e2e0f13-44ae-4f1a-b71e-8162b45f4ead req-dc8b20a3-f58b-4677-8d76-a0c868ca13ab tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0550718 Nov 12 14:57:40.140487 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5e2e0f13-44ae-4f1a-b71e-8162b45f4ead req-bc03125a-764d-417e-892a-8ceee8b68d16 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0685644 Nov 12 14:57:40.151174 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-e485b2de-2dda-4ef7-a7ba-b2ef6a084609 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:40.152740 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-e485b2de-2dda-4ef7-a7ba-b2ef6a084609 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 1099 time: 0.0591903 Nov 12 14:57:40.281722 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-85a56047-3982-448e-ae3c-a92cc320e42f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:40.283224 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-85a56047-3982-448e-ae3c-a92cc320e42f service neutron] 10.222.0.86 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 912 time: 0.1135180 Nov 12 14:57:40.368550 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-e73bbde4-a2c3-4030-9a0c-74ba41dcb6d4 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6404f751-2813-4de0-aa94-89a7df49823a HTTP/1.1" status: 200 len: 1000 time: 0.0744965 Nov 12 14:57:40.431255 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-2e3c3e77-ca27-4cf4-8bf1-16b2e842566d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:40.432801 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-2e3c3e77-ca27-4cf4-8bf1-16b2e842566d service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 200 len: 850 time: 0.0542400 Nov 12 14:57:40.498369 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-44e70c17-2ef7-45f8-94f8-e873f787979c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:40.500566 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-44e70c17-2ef7-45f8-94f8-e873f787979c service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0490518 Nov 12 14:57:40.686164 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-96f3efa1-a1f6-46da-879a-d8e19cf271dc service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1719446 Nov 12 14:57:40.851818 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ee4c5dd2-87b4-4e28-beff-2b49b5c7e6eb req-340a9603-b22d-49c6-9d80-5ba3f06d77d3 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1505280 Nov 12 14:57:41.113459 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4bf3519-d789-4c81-8fd9-cef3b3af68a7 req-172ed592-b25c-4b11-a5c2-6ad572696803 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:41.115217 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4bf3519-d789-4c81-8fd9-cef3b3af68a7 req-172ed592-b25c-4b11-a5c2-6ad572696803 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 943 time: 0.1004803 Nov 12 14:57:41.136636 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-a3ce2ffd-7538-4944-8945-97183f27d791 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:41.138115 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-a3ce2ffd-7538-4944-8945-97183f27d791 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1098 time: 0.0800841 Nov 12 14:57:41.204531 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9422fa5b-7a8d-4a85-a7ef-0e1a45ba8904 req-1724707a-ad7c-4879-a8e6-23ba87d0ebef tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:41.208219 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9422fa5b-7a8d-4a85-a7ef-0e1a45ba8904 req-1724707a-ad7c-4879-a8e6-23ba87d0ebef tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.1035738 Nov 12 14:57:41.240235 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4bf3519-d789-4c81-8fd9-cef3b3af68a7 req-8639b1df-6e5b-439c-8da1-8afe676c9c4d tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1138558 Nov 12 14:57:41.294862 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-48aca5b3-5fdd-405f-b1f7-b14e600e056c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:41.295709 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9422fa5b-7a8d-4a85-a7ef-0e1a45ba8904 req-1b263861-66e1-45a7-a8c7-4d182a3b21bc tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720570 Nov 12 14:57:41.298020 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-48aca5b3-5fdd-405f-b1f7-b14e600e056c service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 919 time: 0.1498706 Nov 12 14:57:41.376479 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-dd1b3bb8-2e72-4272-85d2-1246b10a1e3a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18 HTTP/1.1" status: 200 len: 217 time: 0.0692818 Nov 12 14:57:41.544378 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7962cfc8-7377-4593-8573-52a518a7c0d9 req-08ee933e-e46d-4c5e-86ad-20cceacc759c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:41.554693 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7962cfc8-7377-4593-8573-52a518a7c0d9 req-08ee933e-e46d-4c5e-86ad-20cceacc759c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1401579 Nov 12 14:57:41.840498 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-346c591e-3a5c-4a1c-94e8-6469aab6270e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:41.842650 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-346c591e-3a5c-4a1c-94e8-6469aab6270e service neutron] 10.222.0.86 "GET /v2.0/subnets?id=03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 200 len: 858 time: 0.4538474 Nov 12 14:57:41.886416 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7962cfc8-7377-4593-8573-52a518a7c0d9 req-d97a3b6d-8663-4a63-bff1-5b6b7165e19a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3113453 Nov 12 14:57:41.904081 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-a600d7a1-c404-476c-a332-67639ee2932b service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0450363 Nov 12 14:57:42.072714 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-a2aa67c8-886a-4066-a496-6fa2c70b861c service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1517429 Nov 12 14:57:42.224635 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-229a142b-1e80-4d94-8c91-cbb466aad2f1 req-adfa7a8d-f2ce-4404-97f0-d1aa905665ee service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1427357 Nov 12 14:57:42.411348 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d6d185-b031-4903-97c6-4e2fa4140d24 req-0d9375bf-8c16-4eb1-b648-269f211a0134 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:42.419516 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-70d6d185-b031-4903-97c6-4e2fa4140d24 req-0d9375bf-8c16-4eb1-b648-269f211a0134 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 943 time: 0.0813746 Nov 12 14:57:42.480914 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d1af87-8710-45d4-be87-7a909c23cbb5 req-a7d5fbc0-c77e-40eb-b94d-029108035958 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:42.488553 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-70d1af87-8710-45d4-be87-7a909c23cbb5 req-a7d5fbc0-c77e-40eb-b94d-029108035958 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0852818 Nov 12 14:57:42.508646 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-70d6d185-b031-4903-97c6-4e2fa4140d24 req-b3b03148-f1e8-471f-9460-f46d9083f967 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0881789 Nov 12 14:57:42.608411 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-70d1af87-8710-45d4-be87-7a909c23cbb5 req-25a16858-60f5-4c45-8856-7c3f908a0695 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1185327 Nov 12 14:57:42.945103 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ceb7b586-44d0-4731-bf8d-973537662c03 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:57:43.078604 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36a6083b-67c8-4554-a66a-1ece7716dde6 req-44f8dd7f-0917-4e7f-b789-a0e485c4770a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:43.084986 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-36a6083b-67c8-4554-a66a-1ece7716dde6 req-44f8dd7f-0917-4e7f-b789-a0e485c4770a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0833063 Nov 12 14:57:43.177208 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-36a6083b-67c8-4554-a66a-1ece7716dde6 req-31163681-387f-438e-a81a-19d56441a6d8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0837445 Nov 12 14:57:43.198825 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ceb7b586-44d0-4731-bf8d-973537662c03, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ceb7b586-44d0-4731-bf8d-973537662c03,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:57:43.223744 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'ceb7b586-44d0-4731-bf8d-973537662c03', 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096', 'port_id': 'ceb7b586-44d0-4731-bf8d-973537662c03', 'mac_address': 'fa:16:3e:90:9c:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 609, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e3c6e311-60aa-48d4-9047-fdea4100c035', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:57:43.288711 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:43.306516 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ceb7b586-44d0-4731-bf8d-973537662c03 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:57:43.337691 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ceb7b586-44d0-4731-bf8d-973537662c03, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ceb7b586-44d0-4731-bf8d-973537662c03,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:57:43.344809 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:43.410096 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=ceb7b586-44d0-4731-bf8d-973537662c03,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:43.680052 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36200e71-8005-43dc-be10-4013706a29f3 req-ce11b1a3-9070-4418-b120-473d94509d43 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:43.692231 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['ceb7b586-44d0-4731-bf8d-973537662c03'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:57:43.696800 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-36200e71-8005-43dc-be10-4013706a29f3 req-ce11b1a3-9070-4418-b120-473d94509d43 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 944 time: 0.0853255 Nov 12 14:57:43.799719 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-36200e71-8005-43dc-be10-4013706a29f3 req-fd580961-bf00-45a1-b3f0-a57eee77fbcc tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025965 Nov 12 14:57:43.802466 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d54c7f6-31eb-4c1d-9404-fccc04754a62 req-984c14fb-95dd-4d80-9e23-de841093382a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:43.804094 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9d54c7f6-31eb-4c1d-9404-fccc04754a62 req-984c14fb-95dd-4d80-9e23-de841093382a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.1009781 Nov 12 14:57:43.914824 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9d54c7f6-31eb-4c1d-9404-fccc04754a62 req-343a2719-b346-4bda-88cc-291061582ba1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1036527 Nov 12 14:57:44.965479 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ceb7b586-44d0-4731-bf8d-973537662c03 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:57:44.972565 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27780998-4d01-4f71-b9cb-38d858b63ae0 req-038788ab-9d43-4553-8e7f-485589801290 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:44.975659 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-27780998-4d01-4f71-b9cb-38d858b63ae0 req-038788ab-9d43-4553-8e7f-485589801290 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 944 time: 0.0920112 Nov 12 14:57:45.062825 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-27780998-4d01-4f71-b9cb-38d858b63ae0 req-7f0e55a9-38e8-47f4-ab66-47c73a0170ed tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779965 Nov 12 14:57:45.102641 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port ceb7b586-44d0-4731-bf8d-973537662c03 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:57:45.110282 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port ceb7b586-44d0-4731-bf8d-973537662c03 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:57:45.111639 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:45.112953 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad7e017-3ff4-4444-a0d3-bb4cbb992413 req-4f0bc126-5d72-4637-8508-e28818a82f45 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:45.123756 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cad7e017-3ff4-4444-a0d3-bb4cbb992413 req-4f0bc126-5d72-4637-8508-e28818a82f45 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.1118262 Nov 12 14:57:45.187611 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cad7e017-3ff4-4444-a0d3-bb4cbb992413 req-a8c68fb6-1159-49e0-bdf0-57b68fbf5685 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624681 Nov 12 14:57:45.251595 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:45.300777 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ef1c882c-ba88-4910-9c4d-c9bf784a916e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ceb7b586-44d0-4731-bf8d-973537662c03'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:57:45.303412 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53d624a4-4707-4740-b5df-88f9b9ecc759" -d '{"events": [{"server_uuid": "ef1c882c-ba88-4910-9c4d-c9bf784a916e", "name": "network-vif-plugged", "status": "completed", "tag": "ceb7b586-44d0-4731-bf8d-973537662c03"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:57:45.320728 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ceb7b586-44d0-4731-bf8d-973537662c03, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ceb7b586-44d0-4731-bf8d-973537662c03,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:57:45.326296 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:45.382713 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=ceb7b586-44d0-4731-bf8d-973537662c03,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:57:45.392070 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:57:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd76507f-1669-4710-ae82-89c9120bccda x-openstack-request-id: req-cd76507f-1669-4710-ae82-89c9120bccda {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:57:45.392488 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ef1c882c-ba88-4910-9c4d-c9bf784a916e", "name": "network-vif-plugged", "status": "completed", "tag": "ceb7b586-44d0-4731-bf8d-973537662c03", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:57:45.392719 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-cd76507f-1669-4710-ae82-89c9120bccda {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:57:45.393712 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ef1c882c-ba88-4910-9c4d-c9bf784a916e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ceb7b586-44d0-4731-bf8d-973537662c03', 'code': 200} Nov 12 14:57:45.608757 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49161d17-7a5a-47cd-99dc-391d00cefb04 req-d797b036-62c1-4a18-9b51-92bf9d65d01c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:45.611058 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-49161d17-7a5a-47cd-99dc-391d00cefb04 req-d797b036-62c1-4a18-9b51-92bf9d65d01c service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 1098 time: 0.0479381 Nov 12 14:57:45.681192 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-49161d17-7a5a-47cd-99dc-391d00cefb04 req-00ee3cd6-48e8-44a9-a9e2-b2f3d3c00da1 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522134 Nov 12 14:57:46.195374 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe1e213e-fe7e-413b-bfff-9935335853dd req-2d8725fc-814c-416e-b4ce-30ba173d9819 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:46.197397 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fe1e213e-fe7e-413b-bfff-9935335853dd req-2d8725fc-814c-416e-b4ce-30ba173d9819 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 945 time: 0.0620077 Nov 12 14:57:46.264024 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fe1e213e-fe7e-413b-bfff-9935335853dd req-3ddf001b-e0f0-480f-b7e2-0a5bf59412e0 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505207 Nov 12 14:57:46.379068 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c675b74-d52e-4c91-8ead-3308ab9b1e0c req-b3db78ec-299c-43cd-995f-3dc2afaf9d0e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:46.380808 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9c675b74-d52e-4c91-8ead-3308ab9b1e0c req-b3db78ec-299c-43cd-995f-3dc2afaf9d0e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0592439 Nov 12 14:57:46.448457 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9c675b74-d52e-4c91-8ead-3308ab9b1e0c req-8c4d91b0-53c7-4dd3-b611-91bafad49f03 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541842 Nov 12 14:57:47.421046 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d44a50-f830-4811-80dd-77cd8b362bdc req-d2537778-4e80-40d1-af43-a90f7b3e2f4a tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:47.422790 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-59d44a50-f830-4811-80dd-77cd8b362bdc req-d2537778-4e80-40d1-af43-a90f7b3e2f4a tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 945 time: 0.0659232 Nov 12 14:57:47.476800 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-59d44a50-f830-4811-80dd-77cd8b362bdc req-71084d83-baca-475d-a5e2-7ee3c4f762e1 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472701 Nov 12 14:57:47.607182 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-061d3112-9fd2-453a-adea-169fb42f3ad4 req-74cf296a-3db0-4562-9ec1-d57bc0512bf8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:47.608814 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-061d3112-9fd2-453a-adea-169fb42f3ad4 req-74cf296a-3db0-4562-9ec1-d57bc0512bf8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0579388 Nov 12 14:57:47.666239 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-061d3112-9fd2-453a-adea-169fb42f3ad4 req-a3b34566-e385-4f53-9972-1eb3c058bab2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508900 Nov 12 14:57:48.334682 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:57:48.802857 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abe15d8-fd05-411b-b633-638c5ee80002 req-3a48d80f-d414-48dd-8837-33a37f3a7958 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:48.804785 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2abe15d8-fd05-411b-b633-638c5ee80002 req-3a48d80f-d414-48dd-8837-33a37f3a7958 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0548630 Nov 12 14:57:48.863069 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2abe15d8-fd05-411b-b633-638c5ee80002 req-87ab6b6a-3933-4f9b-855f-bdc2e549913f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521808 Nov 12 14:57:49.992190 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f84273-a523-424a-be14-105d9564139d req-7962072a-6e95-415e-91db-316bcfbc3ec7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:49.994559 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d6f84273-a523-424a-be14-105d9564139d req-7962072a-6e95-415e-91db-316bcfbc3ec7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0500743 Nov 12 14:57:50.050963 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d6f84273-a523-424a-be14-105d9564139d req-da638484-f6eb-467e-a978-9a1fb30ffd23 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505199 Nov 12 14:57:51.204749 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c801be6-65cd-4f8c-ae4b-0c5314cd52ba req-77c09f6f-0c1d-43d3-82a5-7bd03d90501c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:51.207293 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c801be6-65cd-4f8c-ae4b-0c5314cd52ba req-77c09f6f-0c1d-43d3-82a5-7bd03d90501c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0803089 Nov 12 14:57:51.268265 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c801be6-65cd-4f8c-ae4b-0c5314cd52ba req-6a5c5cb3-0b51-4950-b1c6-d0560446737e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506766 Nov 12 14:57:52.096620 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e57ef580-74c6-4de0-b0f6-957985e296b3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:52.399389 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c3a39b3-c666-49d7-a2ec-3b0b6d49ac4e req-a2e3ab00-313b-418c-b41a-8ef55ad97e67 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:52.407220 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9c3a39b3-c666-49d7-a2ec-3b0b6d49ac4e req-a2e3ab00-313b-418c-b41a-8ef55ad97e67 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0596023 Nov 12 14:57:52.452512 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9c3a39b3-c666-49d7-a2ec-3b0b6d49ac4e req-506da921-6b94-4e3c-9104-d8a4b67553c9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441914 Nov 12 14:57:53.583128 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5791904f-1d89-4919-a08e-ca1c66131dff req-a6171db4-6988-46df-9485-e379071c4242 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:53.584528 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5791904f-1d89-4919-a08e-ca1c66131dff req-a6171db4-6988-46df-9485-e379071c4242 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0567186 Nov 12 14:57:53.634639 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5791904f-1d89-4919-a08e-ca1c66131dff req-0de777d0-433d-4bec-b049-0d33b9d5b5f4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435519 Nov 12 14:57:54.520531 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7b39b3f4-b580-49f3-a4d4-5e9f3722ddb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:54.761775 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c387fa-c39d-4eb9-befd-ae019fe32572 req-8c0941f6-6430-409e-a215-2df02a754ee9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:54.763394 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-98c387fa-c39d-4eb9-befd-ae019fe32572 req-8c0941f6-6430-409e-a215-2df02a754ee9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0540326 Nov 12 14:57:54.824872 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-98c387fa-c39d-4eb9-befd-ae019fe32572 req-1067f96b-c0a4-4848-b4d3-fbebf12dcf3b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528049 Nov 12 14:57:55.525847 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:55.945935 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43fbf11-fe63-4138-9459-21040a3d0515 req-b926005f-5522-457c-985e-e0613b33a238 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:55.947322 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a43fbf11-fe63-4138-9459-21040a3d0515 req-b926005f-5522-457c-985e-e0613b33a238 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0526981 Nov 12 14:57:56.006965 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a43fbf11-fe63-4138-9459-21040a3d0515 req-799df950-ff00-45eb-b98a-f7da0ca405a2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530112 Nov 12 14:57:56.917142 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:57.161556 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d27e7e-1908-479d-b456-b780e8ce0ad9 req-b351a867-6905-4171-ba25-c15f559a06d7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:57.163204 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d8d27e7e-1908-479d-b456-b780e8ce0ad9 req-b351a867-6905-4171-ba25-c15f559a06d7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0633149 Nov 12 14:57:57.215292 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d8d27e7e-1908-479d-b456-b780e8ce0ad9 req-ca581ab9-d3e8-4d7c-9604-a18662a93e6e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442927 Nov 12 14:57:57.900079 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:57:58.365052 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17172992-1b51-4310-b7b0-d228d788bad8 req-db876c07-b4a0-4075-b21d-35d6410c4ed2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:58.367371 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-17172992-1b51-4310-b7b0-d228d788bad8 req-db876c07-b4a0-4075-b21d-35d6410c4ed2 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0641372 Nov 12 14:57:58.426184 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-17172992-1b51-4310-b7b0-d228d788bad8 req-04cd05b2-c3ed-4c6b-9c98-50c6ac5fa170 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511696 Nov 12 14:57:59.560199 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9a2fd7-e10b-40bd-9e21-72d4adb0891a req-fcc15667-8f6a-4cb9-9708-a0ac719fd01d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:57:59.561595 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cb9a2fd7-e10b-40bd-9e21-72d4adb0891a req-fcc15667-8f6a-4cb9-9708-a0ac719fd01d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0542879 Nov 12 14:57:59.611760 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cb9a2fd7-e10b-40bd-9e21-72d4adb0891a req-8c5a06ec-532f-4160-acc2-929b3e58eabe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441108 Nov 12 14:58:00.752478 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fdb6486-3862-40b2-a454-1abb224ff6dc req-db4d183f-10ac-46ae-a601-2dc22f739d32 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:00.753965 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8fdb6486-3862-40b2-a454-1abb224ff6dc req-db4d183f-10ac-46ae-a601-2dc22f739d32 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0675931 Nov 12 14:58:00.809294 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8fdb6486-3862-40b2-a454-1abb224ff6dc req-e5b1322b-3b23-43b1-a92f-382b1cd4680d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492990 Nov 12 14:58:01.942980 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d30d518-a5c1-4f91-bbf7-aef62f339fa4 req-0cb6f1a3-f8e8-41a1-a061-e6338c7103d1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:01.944659 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2d30d518-a5c1-4f91-bbf7-aef62f339fa4 req-0cb6f1a3-f8e8-41a1-a061-e6338c7103d1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0596173 Nov 12 14:58:01.996141 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2d30d518-a5c1-4f91-bbf7-aef62f339fa4 req-0bc98308-8d4d-465e-bf87-439bb3e5cbc9 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452673 Nov 12 14:58:03.148201 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07ca7eb-5095-4502-a0fa-60f647a2a223 req-c954a802-a089-4ff7-9d35-4f50c206bef1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:03.149793 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a07ca7eb-5095-4502-a0fa-60f647a2a223 req-c954a802-a089-4ff7-9d35-4f50c206bef1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0708930 Nov 12 14:58:03.220389 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a07ca7eb-5095-4502-a0fa-60f647a2a223 req-5ebfc0b3-4146-4494-870b-5dc4770b0488 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642664 Nov 12 14:58:03.794840 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-07eaf670-cef2-412b-a2cb-97b0c5fc6ce7 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0540504 Nov 12 14:58:03.888717 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-f23cb8ca-9d32-4742-aec4-3aacd5fda2ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:03.890275 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-f23cb8ca-9d32-4742-aec4-3aacd5fda2ad service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 1098 time: 0.0663810 Nov 12 14:58:04.003421 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-ae3d2086-6d57-4d56-833e-7a544a5c77b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:04.004486 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-ae3d2086-6d57-4d56-833e-7a544a5c77b4 service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 919 time: 0.0859008 Nov 12 14:58:04.063740 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-43b47812-b931-489d-ad2c-c881b4392293 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=116218b4-72d9-40d7-bcaf-24faa7227810 HTTP/1.1" status: 200 len: 217 time: 0.0504050 Nov 12 14:58:04.121867 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-bd8464e5-91de-45eb-a928-a0ff1df8aee6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:04.123447 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-bd8464e5-91de-45eb-a928-a0ff1df8aee6 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 200 len: 858 time: 0.0492334 Nov 12 14:58:04.158637 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-2691bb80-72c4-4bae-a79d-0e71c1830d66 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0268109 Nov 12 14:58:04.279155 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-a080e77f-efd0-4569-a55f-6e15e2a61703 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1030681 Nov 12 14:58:04.349829 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d471f28-3d93-4e5a-a816-7d6a9f081243 req-02d31076-564d-44d0-847e-9b1e7bf95e95 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:04.351511 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1d471f28-3d93-4e5a-a816-7d6a9f081243 req-02d31076-564d-44d0-847e-9b1e7bf95e95 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0579171 Nov 12 14:58:04.389203 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-638fcc86-e645-4e6d-a36c-8b7c2ed65d9e req-c88052ae-023a-43dc-9ac3-718ebb687221 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944555 Nov 12 14:58:04.405070 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1d471f28-3d93-4e5a-a816-7d6a9f081243 req-0ef5d04a-41d5-4ff8-b247-2ff1cde2c7c6 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471721 Nov 12 14:58:04.929954 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:05.535748 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50a1b650-707d-48c6-a501-5f25ce7abcac req-82eb18ce-5216-4b48-8fce-687b7858476e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:05.537261 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-50a1b650-707d-48c6-a501-5f25ce7abcac req-82eb18ce-5216-4b48-8fce-687b7858476e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0552309 Nov 12 14:58:05.592500 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-50a1b650-707d-48c6-a501-5f25ce7abcac req-7ca79dcc-be88-440b-8401-75c0d119d4f0 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493774 Nov 12 14:58:06.725015 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20207e92-688f-48a7-acf3-634df94f9809 req-be39d932-4f01-430c-9068-d7cc24277eaf tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:06.726758 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-20207e92-688f-48a7-acf3-634df94f9809 req-be39d932-4f01-430c-9068-d7cc24277eaf tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0555027 Nov 12 14:58:06.781201 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-20207e92-688f-48a7-acf3-634df94f9809 req-57fd79ba-546e-4263-84af-f9f68c0956ff tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476024 Nov 12 14:58:07.917361 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d91dd9-b15b-4ae8-8c54-247067450a14 req-03b571cf-348a-483d-b8cc-22a4f95eb567 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:07.919719 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-58d91dd9-b15b-4ae8-8c54-247067450a14 req-03b571cf-348a-483d-b8cc-22a4f95eb567 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0591199 Nov 12 14:58:07.985002 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-58d91dd9-b15b-4ae8-8c54-247067450a14 req-f4e17d17-a8fb-4ab4-a6d9-80c0da691c82 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581543 Nov 12 14:58:09.110138 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4043bc53-7a23-4ccf-b1a8-8b243a5dea5b req-6fa1e68a-e291-48ef-a980-759c982fec73 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:09.112434 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4043bc53-7a23-4ccf-b1a8-8b243a5dea5b req-6fa1e68a-e291-48ef-a980-759c982fec73 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0544906 Nov 12 14:58:09.183755 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4043bc53-7a23-4ccf-b1a8-8b243a5dea5b req-8a7715ac-d861-4470-aeb5-f4f279ee588a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632536 Nov 12 14:58:10.300664 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbcde07b-1712-48fa-9942-81cd0694b817 req-322bda97-1793-4f4f-8106-ea2f7d3373a8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:10.302148 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cbcde07b-1712-48fa-9942-81cd0694b817 req-322bda97-1793-4f4f-8106-ea2f7d3373a8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0528204 Nov 12 14:58:10.352098 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cbcde07b-1712-48fa-9942-81cd0694b817 req-51c73e8c-f12e-4b36-8aaf-31cae52003d0 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434747 Nov 12 14:58:10.355102 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98725608-817a-4726-8c8c-3b227cef9f84 req-da285010-0831-42ef-9738-65e593eaaded tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:10.356605 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98725608-817a-4726-8c8c-3b227cef9f84 req-da285010-0831-42ef-9738-65e593eaaded tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0503252 Nov 12 14:58:10.408738 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98725608-817a-4726-8c8c-3b227cef9f84 req-112e8713-73bd-407a-8843-d5a17db72c4a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451615 Nov 12 14:58:11.490943 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3579005b-f126-45cf-94ac-6f2151ce345d req-c0633b17-aa93-40aa-a60b-e2c840d4f9fe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:11.499627 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3579005b-f126-45cf-94ac-6f2151ce345d req-c0633b17-aa93-40aa-a60b-e2c840d4f9fe tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0767627 Nov 12 14:58:11.546002 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fe0328-52f0-42b9-a1f7-9a640920cd03 req-93064506-244f-45e8-9f72-fd748d3a65f0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:11.547682 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35fe0328-52f0-42b9-a1f7-9a640920cd03 req-93064506-244f-45e8-9f72-fd748d3a65f0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0590048 Nov 12 14:58:11.555286 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3579005b-f126-45cf-94ac-6f2151ce345d req-322806b2-bc2f-4ac8-9685-93a0256e1c2e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549033 Nov 12 14:58:11.598870 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35fe0328-52f0-42b9-a1f7-9a640920cd03 req-984213a9-7516-47c6-8bb1-4396f0d91517 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447674 Nov 12 14:58:12.674859 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312173ed-01ac-405b-8e21-1e9f612bd29e req-28cc1b32-e5dd-45bc-87b3-0c743a853956 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:12.676558 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-312173ed-01ac-405b-8e21-1e9f612bd29e req-28cc1b32-e5dd-45bc-87b3-0c743a853956 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0490427 Nov 12 14:58:12.724091 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-353c9934-8063-4699-b5ef-af0ce8571ac6 req-409252d1-bb5b-401b-84f1-d7af59648e27 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:12.725602 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-353c9934-8063-4699-b5ef-af0ce8571ac6 req-409252d1-bb5b-401b-84f1-d7af59648e27 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0539212 Nov 12 14:58:12.732328 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-312173ed-01ac-405b-8e21-1e9f612bd29e req-ba3075d4-f0b8-4b8f-aa12-e99dc39acd20 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500047 Nov 12 14:58:12.750263 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58062) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:12.775989 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-353c9934-8063-4699-b5ef-af0ce8571ac6 req-80c08599-73ff-4d15-87d3-f5fcdf766f8f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441949 Nov 12 14:58:12.795484 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Deleting subnet 91f83bd1-9576-4d8f-9a67-268c7bf31499 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 14:58:12.798567 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:12.838334 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:12.876296 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:12.928787 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:12.952657 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=91f83bd1-9576-4d8f-9a67-268c7bf31499,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:12.959507 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:12.962827 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] 10.222.0.61 "DELETE /v2.0/subnets/91f83bd1-9576-4d8f-9a67-268c7bf31499 HTTP/1.1" status: 204 len: 168 time: 0.2115715 Nov 12 14:58:12.965427 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 58064) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:12.968269 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.968627 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.968971 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.969307 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.969656 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.969970 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.970320 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.970613 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.970941 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.971264 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.971584 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:12.971900 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bf7003c4-2e7a-462d-a1da-0ff193ba7bdb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.049499 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.131972 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.152881 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > segment before_delete 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.153260 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.154013 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.154344 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > port after_create 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.154661 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > port after_delete 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.154989 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > port after_update 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.155284 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > segment after_delete 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.155616 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.155935 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.156299 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > subnet after_update 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.264179 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > subnet after_create 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.264524 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.264846 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > subnet before_create 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.265162 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Subscribe: > subnet before_update 55550000 {{(pid=101618) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 12 14:58:13.265527 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6ec68ee4-86ea-4750-8c5b-ad6204b38664']}} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:13.283090 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3e64eb13-260c-404a-8e4f-19728a3fbcf8') {'for_net_delete': True} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:13.283379 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3e64eb13-260c-404a-8e4f-19728a3fbcf8') {} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:13.299792 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4359949'] for segment, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.320502 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.329546 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Releasing vlan 601 on physical network physnet1 to pool {{(pid=101618) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 14:58:13.329933 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5822932'] for segment, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: from cryptography.utils import int_from_bytes Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: from cryptography.utils import int_from_bytes Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: Traceback (most recent call last): Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: timer() Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: cb(*args, **kw) Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: return func(*args, **kwargs) Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: self._notify() Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: self.callback(batched_events) Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: event.method(event) Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: return f(self, *a, **k) Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._get(url).json() Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: return self.request(url, 'GET', **kwargs) Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 14:58:13.333938 dv-cinder-776422-5-iscsi neutron-server[101618]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 14:58:13.393044 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.401302 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.404929 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] 10.222.0.61 "DELETE /v2.0/networks/6ec68ee4-86ea-4750-8c5b-ad6204b38664 HTTP/1.1" status: 204 len: 168 time: 0.4385109 Nov 12 14:58:13.414715 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Pushing event deleted for resources: {'Network': ['ID=6ec68ee4-86ea-4750-8c5b-ad6204b38664,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:13.422626 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.422978 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.423316 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.423649 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.423978 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.424331 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.424660 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.424993 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.425317 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.425636 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.425961 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.426257 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b648894-bdc3-45dc-bbed-68366125602f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:13.522131 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 58072) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:13.562345 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-2222fdcb-9f30-4b31-bf13-24fe280d6683 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=541f7684cc1c484fb8cde1d45d8b538e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0390022 Nov 12 14:58:13.564752 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 58074) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:13.610178 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e918d738-0892-4852-bcf1-24afd8389fec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.633185 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e918d738-0892-4852-bcf1-24afd8389fec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.680724 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e918d738-0892-4852-bcf1-24afd8389fec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.683361 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e918d738-0892-4852-bcf1-24afd8389fec admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:13.684519 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-e918d738-0892-4852-bcf1-24afd8389fec admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/e4fdb723-2bdc-45bd-81eb-e565bc5a9095 HTTP/1.1" status: 204 len: 168 time: 0.1188800 Nov 12 14:58:13.692446 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e918d738-0892-4852-bcf1-24afd8389fec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4fdb723-2bdc-45bd-81eb-e565bc5a9095,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:13.861172 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-094048b6-8c36-4181-843f-9016e4370052 req-05f61055-c5f5-461d-b9b5-675747faf6bb tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:13.862967 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-094048b6-8c36-4181-843f-9016e4370052 req-05f61055-c5f5-461d-b9b5-675747faf6bb tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0537755 Nov 12 14:58:13.916612 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-094048b6-8c36-4181-843f-9016e4370052 req-f1fcad7d-5494-400a-ac99-0aaa3ebff26b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467994 Nov 12 14:58:13.926049 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f7411e-6e5d-48cb-9a08-e7c24cb23e17 req-29cea499-67b8-4f5a-910e-0169cad3fed7 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:13.928242 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e2f7411e-6e5d-48cb-9a08-e7c24cb23e17 req-29cea499-67b8-4f5a-910e-0169cad3fed7 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0718675 Nov 12 14:58:13.982397 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e2f7411e-6e5d-48cb-9a08-e7c24cb23e17 req-517e2a8b-64cc-46e4-8fdd-9da50326af2f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477343 Nov 12 14:58:14.088045 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35463e88-6053-4489-b14a-60b8d77c2e64 req-0f709316-88a5-4026-b103-8d5a18df3a51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:14.089583 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35463e88-6053-4489-b14a-60b8d77c2e64 req-0f709316-88a5-4026-b103-8d5a18df3a51 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1098 time: 0.0487893 Nov 12 14:58:14.140287 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35463e88-6053-4489-b14a-60b8d77c2e64 req-9ba0e368-4776-465d-8092-de4d148cbb96 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399773 Nov 12 14:58:15.036584 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5227536a-c96a-41fc-a740-55309c8a7518 req-4ef23da6-939c-47b1-84fe-9c1cfb7eceef tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:15.037996 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5227536a-c96a-41fc-a740-55309c8a7518 req-4ef23da6-939c-47b1-84fe-9c1cfb7eceef tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0532696 Nov 12 14:58:15.089445 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5227536a-c96a-41fc-a740-55309c8a7518 req-454ba6c0-02dd-49c1-a4ab-f68e4cc0fcd1 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443482 Nov 12 14:58:15.105347 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21fd3164-a4d5-49e0-8018-00be91769228 req-8f9a6695-22e6-4c48-ac3b-7a00a2675655 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:15.106923 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21fd3164-a4d5-49e0-8018-00be91769228 req-8f9a6695-22e6-4c48-ac3b-7a00a2675655 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0520635 Nov 12 14:58:15.158652 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21fd3164-a4d5-49e0-8018-00be91769228 req-1b71df7c-d648-4682-972b-b53c916f0856 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442204 Nov 12 14:58:16.023890 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-503fcc87-dc35-4e57-a64b-6d0a9a98ffe7 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/networks?tenant_id=a285702c576f4ed0b6a5fc2516e70539&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0299752 Nov 12 14:58:16.211220 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0923757-2cd2-4d50-a5a1-82cd46dd1689 req-4a5ed1b9-b9d3-4850-a74b-d3e1688650eb tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:16.212986 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-4c73d77a-096c-4d44-849d-4e99f343c9c7 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:16.213493 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c0923757-2cd2-4d50-a5a1-82cd46dd1689 req-4a5ed1b9-b9d3-4850-a74b-d3e1688650eb tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0510602 Nov 12 14:58:16.214440 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-4c73d77a-096c-4d44-849d-4e99f343c9c7 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1844482 Nov 12 14:58:16.229188 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-d95c3d52-0331-4192-991a-32e24cb3cd90 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/quotas/a285702c576f4ed0b6a5fc2516e70539 HTTP/1.1" status: 200 len: 375 time: 0.0090306 Nov 12 14:58:16.262504 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c0923757-2cd2-4d50-a5a1-82cd46dd1689 req-4a82db3a-bc09-459f-97c4-f632ae44864f tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430572 Nov 12 14:58:16.263839 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-da6aea4f-1be2-4a67-b7ed-f9509242cbef tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=a285702c576f4ed0b6a5fc2516e70539&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0291159 Nov 12 14:58:16.384342 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b793d9a-2ade-45f7-a6e6-03e851a2683d req-fbb1c50a-35a4-4572-b55d-c76953fe6fc9 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:16.386144 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5b793d9a-2ade-45f7-a6e6-03e851a2683d req-fbb1c50a-35a4-4572-b55d-c76953fe6fc9 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0687079 Nov 12 14:58:16.438120 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5b793d9a-2ade-45f7-a6e6-03e851a2683d req-fd86c4bd-b5b8-41c5-83f3-e7b9e64cc7ab tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440543 Nov 12 14:58:16.530169 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3626f220-76a1-44a8-b854-76c5331d28e3 req-de3e93be-09ee-4295-a73b-a8dfdef8d160 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 210 time: 0.0385051 Nov 12 14:58:16.740651 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-b6149ca0-6129-4298-8312-94285f8a6301 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:16.742419 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-b6149ca0-6129-4298-8312-94285f8a6301 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 1098 time: 0.0736532 Nov 12 14:58:16.761991 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20885541-08d9-4095-8ff0-3113d728e324 req-90eaf962-09c5-48b2-9770-7be33bdd2894 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:16.763824 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-20885541-08d9-4095-8ff0-3113d728e324 req-90eaf962-09c5-48b2-9770-7be33bdd2894 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0845232 Nov 12 14:58:16.873951 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-20885541-08d9-4095-8ff0-3113d728e324 req-b8d4e6f0-6b66-4bcc-972f-83ca7ab8f5e3 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011772 Nov 12 14:58:16.890116 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-cec9451c-b795-43ba-bd21-9e2fc33863e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:16.891571 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-cec9451c-b795-43ba-bd21-9e2fc33863e5 service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 200 len: 919 time: 0.1267107 Nov 12 14:58:16.966686 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-6a67ae3e-953e-461f-b68a-6afeaf4b0af4 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18 HTTP/1.1" status: 200 len: 217 time: 0.0419400 Nov 12 14:58:17.024152 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-ffb54385-e5fc-4ce0-b396-21c78db71855 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:17.025655 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-ffb54385-e5fc-4ce0-b396-21c78db71855 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 200 len: 858 time: 0.0496361 Nov 12 14:58:17.061544 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-0ef2d29f-7005-4e49-9088-0f9b54a3ef1f service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0270617 Nov 12 14:58:17.161270 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-f4abe426-50a8-4eb2-bef5-6a02eb492568 service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864959 Nov 12 14:58:17.265281 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c9affbf-3d3c-4b8f-be5c-8305dae14163 req-2983085b-3cbc-4e21-a74f-0ce9becbda5d service neutron] 10.222.0.86 "GET /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0955715 Nov 12 14:58:17.504617 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-9f8138f2-af4b-48e6-aaee-3413251af206 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.86 "GET /v2.0/networks?tenant_id=a285702c576f4ed0b6a5fc2516e70539&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0294037 Nov 12 14:58:17.573214 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015abb34-775c-4115-b221-6079d0df6fd5 req-0a6236ac-6d84-45f9-8a58-f45f9fb0eb0f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:17.574779 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-015abb34-775c-4115-b221-6079d0df6fd5 req-0a6236ac-6d84-45f9-8a58-f45f9fb0eb0f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0554738 Nov 12 14:58:17.628253 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-015abb34-775c-4115-b221-6079d0df6fd5 req-6bddfa8e-105c-43db-9061-7cfe3209a3ab tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466716 Nov 12 14:58:17.689271 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0240a614-d918-4a22-9edd-f61f16b4a67b req-f3342ef4-8f6e-4495-a27e-a3936e09dc9a tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 210 time: 0.0811336 Nov 12 14:58:17.754029 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-b63aaa95-b5e8-4007-9e6b-8f6f005f3912 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:17.755466 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-b63aaa95-b5e8-4007-9e6b-8f6f005f3912 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2361271 Nov 12 14:58:17.773149 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Request body: {'port': {'device_id': 'a7a5bacc-c7bf-49f2-822e-1e9580367329', 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79', 'admin_state_up': True, 'tenant_id': 'a285702c576f4ed0b6a5fc2516e70539'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:58:17.876901 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Made reservation on behalf of a285702c576f4ed0b6a5fc2516e70539 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:58:17.880303 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:17.889309 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:17.971493 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:17.978284 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:17.998908 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e5a062-cbec-4f8d-b81d-008147ca5997 req-89ba56f5-adea-4bc2-b8fb-ce5521c16c01 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:18.000517 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a0e5a062-cbec-4f8d-b81d-008147ca5997 req-89ba56f5-adea-4bc2-b8fb-ce5521c16c01 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0548151 Nov 12 14:58:18.038450 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Pushing event updated for resources: {'SecurityGroup': ['ID=36120496-522a-47cf-84fe-9afc98af94d5,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:18.048761 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a0e5a062-cbec-4f8d-b81d-008147ca5997 req-980b437c-0210-4e9e-b9a4-7af8d28cef09 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410359 Nov 12 14:58:18.110892 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Allocated IP 192.168.233.120 (eedb8d3b-4491-485a-baa5-f4a9a1678e79/37bb356a-16a4-4d46-b3c4-c0e6bd1e7b39/a1df3353-626f-4991-915e-2a7614ba41d2) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:58:18.265251 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:18.300025 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:18.343431 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Network eedb8d3b-4491-485a-baa5-f4a9a1678e79 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:58:18.348416 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:58:18.351548 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:58:18.384573 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Pushing event updated for resources: {'Port': ['ID=a1df3353-626f-4991-915e-2a7614ba41d2,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:18.412561 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:18.413177 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:18.428794 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-06f5478f-f7f3-4304-86c5-0294086f5934 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.6599064 Nov 12 14:58:18.441453 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Request body: {'port': {'device_id': 'a7a5bacc-c7bf-49f2-822e-1e9580367329', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:58:18.499916 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:18.528902 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-a5251fed-fbf5-43df-b7d6-38c3f0cf4851 None None] Provisioning complete for port a1df3353-626f-4991-915e-2a7614ba41d2 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:58:18.529576 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-a5251fed-fbf5-43df-b7d6-38c3f0cf4851 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:18.564156 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-a5251fed-fbf5-43df-b7d6-38c3f0cf4851 None None] Port a1df3353-626f-4991-915e-2a7614ba41d2 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:58:18.814507 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3ec238f-efaf-4b06-90c1-174a4b249775 req-67538a84-b5ba-405c-a9c9-bfc881520b40 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:18.816213 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d3ec238f-efaf-4b06-90c1-174a4b249775 req-67538a84-b5ba-405c-a9c9-bfc881520b40 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 936 time: 0.0549769 Nov 12 14:58:18.865385 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d3ec238f-efaf-4b06-90c1-174a4b249775 req-ca86823f-bbab-4d07-8de9-020d7dcc2cbd tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430629 Nov 12 14:58:19.022047 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11faace7-d496-47b4-b263-bbf25de36985 req-4cd15a81-8a5a-4678-8d77-3808d30afba2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:19.024077 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-11faace7-d496-47b4-b263-bbf25de36985 req-4cd15a81-8a5a-4678-8d77-3808d30afba2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.3211098 Nov 12 14:58:19.042341 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a1df3353-626f-4991-915e-2a7614ba41d2 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:58:19.055416 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:19.077309 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Transition to ACTIVE for port object a1df3353-626f-4991-915e-2a7614ba41d2 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:58:19.087840 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:19.124676 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-11faace7-d496-47b4-b263-bbf25de36985 req-fae9fffb-59a6-4718-88c8-7cb9c03526af tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0912986 Nov 12 14:58:19.151960 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Pushing event updated for resources: {'Port': ['ID=a1df3353-626f-4991-915e-2a7614ba41d2,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:19.209433 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cb54ba4-7b49-447b-a150-d52a84eb7729 req-8c8e9557-78ba-4991-8040-8bc119a8b857 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:19.217210 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2cb54ba4-7b49-447b-a150-d52a84eb7729 req-8c8e9557-78ba-4991-8040-8bc119a8b857 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0824857 Nov 12 14:58:19.231935 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Attempting to bind port a1df3353-626f-4991-915e-2a7614ba41d2 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:58:19.232347 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Attempting to bind port a1df3353-626f-4991-915e-2a7614ba41d2 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': 'abab7d4b-dd33-47ea-9ae7-a14276956d50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:58:19.232667 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Attempting to bind port a1df3353-626f-4991-915e-2a7614ba41d2 on network eedb8d3b-4491-485a-baa5-f4a9a1678e79 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:58:19.237358 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Port a1df3353-626f-4991-915e-2a7614ba41d2 on network eedb8d3b-4491-485a-baa5-f4a9a1678e79 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:58:19.237669 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Attempting to bind port a1df3353-626f-4991-915e-2a7614ba41d2 on network eedb8d3b-4491-485a-baa5-f4a9a1678e79 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:58:19.243594 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 58, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:58:19.243928 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Checking segment: {'id': 'abab7d4b-dd33-47ea-9ae7-a14276956d50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:58:19.244334 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Bound using segment: {'id': 'abab7d4b-dd33-47ea-9ae7-a14276956d50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:58:19.244757 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Bound port: a1df3353-626f-4991-915e-2a7614ba41d2, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'abab7d4b-dd33-47ea-9ae7-a14276956d50', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 613, 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:58:19.245106 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:19.279191 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2cb54ba4-7b49-447b-a150-d52a84eb7729 req-41b05132-4ece-4eef-ad58-01fd75e5c50a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604877 Nov 12 14:58:19.342720 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] For port a1df3353-626f-4991-915e-2a7614ba41d2, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:58:19.346409 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] For port a1df3353-626f-4991-915e-2a7614ba41d2, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=a1df3353-626f-4991-915e-2a7614ba41d2,segment=NetworkSegment(abab7d4b-dd33-47ea-9ae7-a14276956d50),segment_id=abab7d4b-dd33-47ea-9ae7-a14276956d50)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:58:19.350724 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:19.387994 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:19.388685 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:19.390201 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] 10.222.0.86 "PUT /v2.0/ports/a1df3353-626f-4991-915e-2a7614ba41d2 HTTP/1.1" status: 200 len: 1098 time: 0.9530070 Nov 12 14:58:19.390903 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a7a5bacc-c7bf-49f2-822e-1e9580367329', 'tag': 'a1df3353-626f-4991-915e-2a7614ba41d2'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:58:19.394027 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-534a3059-c1c1-4d6b-b891-d521511924d5" -d '{"events": [{"name": "network-changed", "server_uuid": "a7a5bacc-c7bf-49f2-822e-1e9580367329", "tag": "a1df3353-626f-4991-915e-2a7614ba41d2"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:58:19.462939 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:58:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8f1fa5f-27e1-4601-b041-cb32044cc4ee x-openstack-request-id: req-a8f1fa5f-27e1-4601-b041-cb32044cc4ee {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:58:19.463513 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a7a5bacc-c7bf-49f2-822e-1e9580367329", "tag": "a1df3353-626f-4991-915e-2a7614ba41d2", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:58:19.463850 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-a8f1fa5f-27e1-4601-b041-cb32044cc4ee {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:58:19.465118 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a7a5bacc-c7bf-49f2-822e-1e9580367329', 'tag': 'a1df3353-626f-4991-915e-2a7614ba41d2', 'status': 'completed', 'code': 200} Nov 12 14:58:19.497084 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ca07513-5b03-4b18-9ee4-cb591203d1df service neutron] Pushing event updated for resources: {'Port': ['ID=a1df3353-626f-4991-915e-2a7614ba41d2,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:19.514036 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-2aefc1e5-a970-4d58-b591-1f01b2910b0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:19.515813 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-2aefc1e5-a970-4d58-b591-1f01b2910b0c service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=a285702c576f4ed0b6a5fc2516e70539&device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 1101 time: 0.0708089 Nov 12 14:58:19.564445 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-ec2c5a55-81e6-467b-9f95-67c4839eb3a0 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.120&port_id=a1df3353-626f-4991-915e-2a7614ba41d2 HTTP/1.1" status: 200 len: 217 time: 0.0381866 Nov 12 14:58:19.617079 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-1f35c4e1-91f4-4999-8d97-e56ea20dbbda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:19.619265 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-1f35c4e1-91f4-4999-8d97-e56ea20dbbda service neutron] 10.222.0.86 "GET /v2.0/subnets?id=37bb356a-16a4-4d46-b3c4-c0e6bd1e7b39 HTTP/1.1" status: 200 len: 843 time: 0.0435867 Nov 12 14:58:19.669591 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-6ebca295-8ad0-4ce7-9ba2-4548047d3299 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:19.671248 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-6ebca295-8ad0-4ce7-9ba2-4548047d3299 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=eedb8d3b-4491-485a-baa5-f4a9a1678e79&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0447569 Nov 12 14:58:19.776727 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-51f3e270-56e9-4e77-a07c-1ea4c0e06a20 service neutron] 10.222.0.86 "GET /v2.0/networks/eedb8d3b-4491-485a-baa5-f4a9a1678e79?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0972784 Nov 12 14:58:19.872655 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-98cd6fdd-2476-40b9-8a4c-a4b509866486 req-9f522545-1333-4777-adfc-ab7c369d2a36 service neutron] 10.222.0.86 "GET /v2.0/networks/eedb8d3b-4491-485a-baa5-f4a9a1678e79?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843954 Nov 12 14:58:19.979993 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-59ed7e3b-46e0-4828-b064-fad761a07610 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:19.981730 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-59ed7e3b-46e0-4828-b064-fad761a07610 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=a285702c576f4ed0b6a5fc2516e70539&device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 1101 time: 0.0527096 Nov 12 14:58:19.986625 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af75735d-750d-4a1e-ad27-cf834d9f599b req-51852efa-0f31-4d1f-b36b-a38c9b01c0f6 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:19.988180 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-af75735d-750d-4a1e-ad27-cf834d9f599b req-51852efa-0f31-4d1f-b36b-a38c9b01c0f6 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 948 time: 0.0550270 Nov 12 14:58:20.036769 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-af75735d-750d-4a1e-ad27-cf834d9f599b req-28dcbf4d-7098-41f7-969b-a66b3e847444 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426550 Nov 12 14:58:20.081006 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-75773006-246b-4e73-9174-ae2f9918f8ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:20.082441 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-75773006-246b-4e73-9174-ae2f9918f8ff service neutron] 10.222.0.86 "GET /v2.0/networks?id=eedb8d3b-4491-485a-baa5-f4a9a1678e79 HTTP/1.1" status: 200 len: 870 time: 0.0909963 Nov 12 14:58:20.126618 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-838af6cf-9f20-4748-aba4-ed426101d26b service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.120&port_id=a1df3353-626f-4991-915e-2a7614ba41d2 HTTP/1.1" status: 200 len: 217 time: 0.0366597 Nov 12 14:58:20.186756 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-5530c700-4d80-4339-8f07-b0aa27409ba5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:20.188234 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-5530c700-4d80-4339-8f07-b0aa27409ba5 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=37bb356a-16a4-4d46-b3c4-c0e6bd1e7b39 HTTP/1.1" status: 200 len: 843 time: 0.0460491 Nov 12 14:58:20.266535 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-26c06cde-10cb-4703-afad-59ed85054595 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:20.268001 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-26c06cde-10cb-4703-afad-59ed85054595 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=eedb8d3b-4491-485a-baa5-f4a9a1678e79&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0691879 Nov 12 14:58:20.277245 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a507eb4c-1e9c-44a2-a0f9-8cbf7de29b60 req-3b869afa-43e6-466f-b50b-8c9e8fc31eeb tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:20.278596 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a507eb4c-1e9c-44a2-a0f9-8cbf7de29b60 req-3b869afa-43e6-466f-b50b-8c9e8fc31eeb tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0721579 Nov 12 14:58:20.384399 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a507eb4c-1e9c-44a2-a0f9-8cbf7de29b60 req-c66fa6d8-ef39-46ec-a1a2-41c0fa04cc55 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0972757 Nov 12 14:58:20.416354 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-8fc70436-f922-48b8-a711-a86db73e86f5 service neutron] 10.222.0.86 "GET /v2.0/networks/eedb8d3b-4491-485a-baa5-f4a9a1678e79?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1367733 Nov 12 14:58:20.433963 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d0f709e-d3f3-4743-8669-aa85bb22866c req-37fba8b7-a411-4fb2-bbb2-fa5eb0946045 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:20.435414 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8d0f709e-d3f3-4743-8669-aa85bb22866c req-37fba8b7-a411-4fb2-bbb2-fa5eb0946045 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0591280 Nov 12 14:58:20.484530 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8d0f709e-d3f3-4743-8669-aa85bb22866c req-2c902726-5c8d-4dc4-bd25-a2ab1dc35bfa tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431862 Nov 12 14:58:20.519098 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-534a3059-c1c1-4d6b-b891-d521511924d5 req-c863dcf0-b53d-4aff-ac45-768c1de61747 service neutron] 10.222.0.86 "GET /v2.0/networks/eedb8d3b-4491-485a-baa5-f4a9a1678e79?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0929236 Nov 12 14:58:20.760950 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 58238) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:20.875539 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-88e36b4a-11ac-4798-9cea-bb692953ac9b admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:20.956724 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-88e36b4a-11ac-4798-9cea-bb692953ac9b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:20.961352 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-88e36b4a-11ac-4798-9cea-bb692953ac9b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:21.000783 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-88e36b4a-11ac-4798-9cea-bb692953ac9b admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a3d94b01880645fdb6cece556ade6bfa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2385793 Nov 12 14:58:21.002744 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88e36b4a-11ac-4798-9cea-bb692953ac9b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19898f92-536b-491c-8d2e-980b2b3af77e,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:21.004179 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58246) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:21.051759 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-74490d61-a601-46d0-b530-b466f79a37b5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:21.073386 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-74490d61-a601-46d0-b530-b466f79a37b5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:21.123615 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-74490d61-a601-46d0-b530-b466f79a37b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:21.126203 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-74490d61-a601-46d0-b530-b466f79a37b5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:21.127335 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-74490d61-a601-46d0-b530-b466f79a37b5 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/19898f92-536b-491c-8d2e-980b2b3af77e HTTP/1.1" status: 204 len: 168 time: 0.1218302 Nov 12 14:58:21.135268 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74490d61-a601-46d0-b530-b466f79a37b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19898f92-536b-491c-8d2e-980b2b3af77e,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:21.155121 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65d8c758-519a-4368-a04a-634be1e7afdc req-7838839d-8c9c-4216-ba92-00c64375352d tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:21.156612 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-65d8c758-519a-4368-a04a-634be1e7afdc req-7838839d-8c9c-4216-ba92-00c64375352d tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 948 time: 0.0531766 Nov 12 14:58:21.214493 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-65d8c758-519a-4368-a04a-634be1e7afdc req-1261e70c-fb7b-47d5-9d8d-2a2f8a80f783 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498283 Nov 12 14:58:21.515242 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed299ddb-be57-438c-bb5f-9d7c19ed7ddd req-b3dcec33-e4b2-4c14-b59e-97c1d1721d5a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:21.516722 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ed299ddb-be57-438c-bb5f-9d7c19ed7ddd req-b3dcec33-e4b2-4c14-b59e-97c1d1721d5a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0497735 Nov 12 14:58:21.566973 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ed299ddb-be57-438c-bb5f-9d7c19ed7ddd req-cc4253af-44e6-4dc2-8363-5ce3c3c70074 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429354 Nov 12 14:58:22.096426 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-58eab4f6-c00a-4019-9373-07ba69113d31 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:22.329282 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48930a80-f4d6-4b25-a1f4-e179b29ecf54 req-1765c207-bdd6-49e6-a736-fe2821055950 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:22.330747 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-48930a80-f4d6-4b25-a1f4-e179b29ecf54 req-1765c207-bdd6-49e6-a736-fe2821055950 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 948 time: 0.0483365 Nov 12 14:58:22.377083 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-48930a80-f4d6-4b25-a1f4-e179b29ecf54 req-478222a5-4a27-4c66-aade-c754ae27e537 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401802 Nov 12 14:58:22.685799 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-663c81cd-50aa-4c98-b4e8-5bf47f055b71 req-71a3fc0e-5862-4201-8d60-d95d3a9c8cb7 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:22.687269 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-663c81cd-50aa-4c98-b4e8-5bf47f055b71 req-71a3fc0e-5862-4201-8d60-d95d3a9c8cb7 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0494015 Nov 12 14:58:22.734878 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-663c81cd-50aa-4c98-b4e8-5bf47f055b71 req-76bc1dfd-7edf-44a7-8a3a-794e0a439b55 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415149 Nov 12 14:58:23.176921 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device a1df3353-626f-4991-915e-2a7614ba41d2 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:58:23.270666 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port a1df3353-626f-4991-915e-2a7614ba41d2, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=a1df3353-626f-4991-915e-2a7614ba41d2,segment=NetworkSegment(abab7d4b-dd33-47ea-9ae7-a14276956d50),segment_id=abab7d4b-dd33-47ea-9ae7-a14276956d50)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:23.281812 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'a1df3353-626f-4991-915e-2a7614ba41d2', 'network_id': 'eedb8d3b-4491-485a-baa5-f4a9a1678e79', 'port_id': 'a1df3353-626f-4991-915e-2a7614ba41d2', 'mac_address': 'fa:16:3e:ff:e9:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 613, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '37bb356a-16a4-4d46-b3c4-c0e6bd1e7b39', 'ip_address': '192.168.233.120'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:58:23.322791 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:23.336077 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a1df3353-626f-4991-915e-2a7614ba41d2 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:58:23.355790 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port a1df3353-626f-4991-915e-2a7614ba41d2, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=a1df3353-626f-4991-915e-2a7614ba41d2,segment=NetworkSegment(abab7d4b-dd33-47ea-9ae7-a14276956d50),segment_id=abab7d4b-dd33-47ea-9ae7-a14276956d50)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:23.359649 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:23.406045 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=a1df3353-626f-4991-915e-2a7614ba41d2,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:23.413185 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.413557 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.413990 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.414303 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.414515 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.414842 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.415178 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.415495 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.415901 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.416129 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.416452 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.417321 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:58:23.501035 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad0e4f6-d3ac-46de-bf3b-e7e254c29270 req-7633e141-451e-4fc9-b1b7-07c3455e1377 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:23.502519 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9ad0e4f6-d3ac-46de-bf3b-e7e254c29270 req-7633e141-451e-4fc9-b1b7-07c3455e1377 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 949 time: 0.0509522 Nov 12 14:58:23.550645 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9ad0e4f6-d3ac-46de-bf3b-e7e254c29270 req-d7e22599-b136-42f2-9396-babff8051e77 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421848 Nov 12 14:58:23.736256 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['a1df3353-626f-4991-915e-2a7614ba41d2'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:58:23.854425 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f06fbc9-e14c-4b91-bd4a-98a786ae15fd req-5675160d-e3f6-4362-8894-82cb674b7292 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:23.855893 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9f06fbc9-e14c-4b91-bd4a-98a786ae15fd req-5675160d-e3f6-4362-8894-82cb674b7292 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0485690 Nov 12 14:58:23.903885 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9f06fbc9-e14c-4b91-bd4a-98a786ae15fd req-ac5a50e1-7185-4852-ac7a-2eb6f4e307e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415888 Nov 12 14:58:24.427477 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf7b898-e009-4a4a-bcf1-894f4b9c0329 req-3399bf50-363c-4cf4-aa82-6877d115a877 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:24.428980 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2bf7b898-e009-4a4a-bcf1-894f4b9c0329 req-3399bf50-363c-4cf4-aa82-6877d115a877 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0541213 Nov 12 14:58:24.476702 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2bf7b898-e009-4a4a-bcf1-894f4b9c0329 req-ad200fdc-04c8-4583-80a8-21be0edb2e81 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407505 Nov 12 14:58:24.523541 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d1e389d4-4764-4048-ba76-c96154ead7b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:24.665269 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7f3c32f-8bb1-41e8-96ae-22c345e803ae req-1ddf1711-1bc2-4d4c-851f-4b51acab8e8f tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:24.666739 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c7f3c32f-8bb1-41e8-96ae-22c345e803ae req-1ddf1711-1bc2-4d4c-851f-4b51acab8e8f tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 949 time: 0.0489755 Nov 12 14:58:24.713203 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c7f3c32f-8bb1-41e8-96ae-22c345e803ae req-fcef4dbc-9e58-48f7-8837-0c4f11893d8b tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404356 Nov 12 14:58:25.023603 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd23145-24fa-490c-9615-727599b37104 req-91e271af-dfb0-404e-b7a9-5b4b9b585858 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:25.025058 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bdd23145-24fa-490c-9615-727599b37104 req-91e271af-dfb0-404e-b7a9-5b4b9b585858 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0511785 Nov 12 14:58:25.070484 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bdd23145-24fa-490c-9615-727599b37104 req-4da1ee1f-8bcf-4281-a6c6-9ed49d76f9df tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396092 Nov 12 14:58:25.178815 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device a1df3353-626f-4991-915e-2a7614ba41d2 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:58:25.227258 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port a1df3353-626f-4991-915e-2a7614ba41d2 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:58:25.231031 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port a1df3353-626f-4991-915e-2a7614ba41d2 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:58:25.231391 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:25.307579 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:25.329270 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7a5bacc-c7bf-49f2-822e-1e9580367329', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1df3353-626f-4991-915e-2a7614ba41d2'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:58:25.331682 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-675ce86f-0f33-49a2-9eba-4634488025be" -d '{"events": [{"server_uuid": "a7a5bacc-c7bf-49f2-822e-1e9580367329", "name": "network-vif-plugged", "status": "completed", "tag": "a1df3353-626f-4991-915e-2a7614ba41d2"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:58:25.340965 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:58:25.346813 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port a1df3353-626f-4991-915e-2a7614ba41d2, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=a1df3353-626f-4991-915e-2a7614ba41d2,segment=NetworkSegment(abab7d4b-dd33-47ea-9ae7-a14276956d50),segment_id=abab7d4b-dd33-47ea-9ae7-a14276956d50)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:25.350732 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:25.373024 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:58:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6278b751-866f-4237-bef8-695fd310a88e x-openstack-request-id: req-6278b751-866f-4237-bef8-695fd310a88e {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:58:25.373309 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a7a5bacc-c7bf-49f2-822e-1e9580367329", "name": "network-vif-plugged", "status": "completed", "tag": "a1df3353-626f-4991-915e-2a7614ba41d2", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:58:25.373554 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-6278b751-866f-4237-bef8-695fd310a88e {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:58:25.373935 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7a5bacc-c7bf-49f2-822e-1e9580367329', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1df3353-626f-4991-915e-2a7614ba41d2', 'code': 200} Nov 12 14:58:25.402540 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=a1df3353-626f-4991-915e-2a7614ba41d2,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:25.522107 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:25.585152 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99ea8454-a428-4dee-9130-80239b870e13 req-0d104b28-a5b7-49cf-8d76-84791d8639b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:25.586623 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-99ea8454-a428-4dee-9130-80239b870e13 req-0d104b28-a5b7-49cf-8d76-84791d8639b0 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 1103 time: 0.0739181 Nov 12 14:58:25.601662 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659b347f-3161-4786-b9e2-a944d40e5aab req-f0f17cf3-422f-489c-aa63-5f95b540fd8e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:25.603168 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-659b347f-3161-4786-b9e2-a944d40e5aab req-f0f17cf3-422f-489c-aa63-5f95b540fd8e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0606301 Nov 12 14:58:25.671373 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-99ea8454-a428-4dee-9130-80239b870e13 req-9f9e1e19-688e-4a8b-8670-70d1a4f0ffcb service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672221 Nov 12 14:58:25.678647 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-659b347f-3161-4786-b9e2-a944d40e5aab req-3cfa986b-79ab-42ce-82b5-a51ab94796c7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690742 Nov 12 14:58:25.828011 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ed2084-1855-4084-a75e-300177a64bd0 req-fd1b9478-7e6b-47bf-b484-0c0cad70bb50 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:25.829405 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-73ed2084-1855-4084-a75e-300177a64bd0 req-fd1b9478-7e6b-47bf-b484-0c0cad70bb50 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 950 time: 0.0484138 Nov 12 14:58:25.878004 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-73ed2084-1855-4084-a75e-300177a64bd0 req-c706e2b8-7a70-4db7-bc8e-c4823e8b3348 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428126 Nov 12 14:58:26.197069 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d31b945-eb12-4993-b42c-c69471e44ccb req-d10db0ac-5572-4188-a205-88e99d100601 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:26.198549 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7d31b945-eb12-4993-b42c-c69471e44ccb req-d10db0ac-5572-4188-a205-88e99d100601 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0506928 Nov 12 14:58:26.246221 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7d31b945-eb12-4993-b42c-c69471e44ccb req-f62aca1a-41ea-4a4f-96c4-df0c37ef4ffb tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414643 Nov 12 14:58:26.801118 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79350e8b-072b-472a-a961-87b3e2b81b92 req-3a273873-7731-47e1-9523-485380d86d52 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:26.802702 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-79350e8b-072b-472a-a961-87b3e2b81b92 req-3a273873-7731-47e1-9523-485380d86d52 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0572617 Nov 12 14:58:26.858243 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-79350e8b-072b-472a-a961-87b3e2b81b92 req-c3845500-c0a9-4cd2-8840-728343bc391b tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493944 Nov 12 14:58:26.919019 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:27.009268 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c142fd7-de7b-440e-a417-9e75088edf6d req-67dc51da-a777-4457-9223-0f836525e9d2 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:27.011414 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5c142fd7-de7b-440e-a417-9e75088edf6d req-67dc51da-a777-4457-9223-0f836525e9d2 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 950 time: 0.0618749 Nov 12 14:58:27.082290 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5c142fd7-de7b-440e-a417-9e75088edf6d req-c4840fbf-d9e3-4b92-b7ba-c47622b1139e tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549748 Nov 12 14:58:27.367673 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d1c77a5-238f-4339-92f4-6019385dc8b6 req-c1991308-f182-4beb-a98a-76f7059d58eb tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:27.369203 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2d1c77a5-238f-4339-92f4-6019385dc8b6 req-c1991308-f182-4beb-a98a-76f7059d58eb tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0495439 Nov 12 14:58:27.416374 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2d1c77a5-238f-4339-92f4-6019385dc8b6 req-af05bef0-e050-4adc-8237-626aaa365a8c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410171 Nov 12 14:58:27.775051 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-ca407a0a-5dc0-4782-86c2-287ee14041f7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:27.777318 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-ca407a0a-5dc0-4782-86c2-287ee14041f7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.86 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0493233 Nov 12 14:58:27.871547 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Deleting port 116218b4-72d9-40d7-bcaf-24faa7227810 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:58:27.871776 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:27.896395 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:27.998090 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] For port 116218b4-72d9-40d7-bcaf-24faa7227810, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=116218b4-72d9-40d7-bcaf-24faa7227810,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:27.998449 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:28.007662 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21c5ef85-a71a-4cfd-951e-0dd424f5ad56 req-9eecdf58-3cb2-4966-a431-b8ebe7287fa4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:28.009152 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21c5ef85-a71a-4cfd-951e-0dd424f5ad56 req-9eecdf58-3cb2-4966-a431-b8ebe7287fa4 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=79a36c2e-a840-40bd-aaf3-6b40146ff2c5 HTTP/1.1" status: 200 len: 945 time: 0.0816977 Nov 12 14:58:28.033257 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Calling delete_port for 116218b4-72d9-40d7-bcaf-24faa7227810 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:58:28.099280 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-21c5ef85-a71a-4cfd-951e-0dd424f5ad56 req-a288926a-cc4c-4cd2-a6f3-81965ec2edcd tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834978 Nov 12 14:58:28.192295 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:28.206285 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a9f69b9-e763-44a4-897a-8c002930a44e req-05355af9-d997-4453-8edc-3e2b15697d7b tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:28.207755 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4a9f69b9-e763-44a4-897a-8c002930a44e req-05355af9-d997-4453-8edc-3e2b15697d7b tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 950 time: 0.0488007 Nov 12 14:58:28.209502 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['116218b4-72d9-40d7-bcaf-24faa7227810', 'c0d8b239-ac45-4bde-b0fd-049dd324ae18'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:58:28.226214 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Pushing event deleted for resources: {'Port': ['ID=116218b4-72d9-40d7-bcaf-24faa7227810,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:28.269691 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] No DVR routers for this DVR port 116218b4-72d9-40d7-bcaf-24faa7227810 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 14:58:28.272394 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:28.273164 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4a9f69b9-e763-44a4-897a-8c002930a44e req-35d3380e-f7b1-4ada-ad70-baf0ba70b090 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574887 Nov 12 14:58:28.276494 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c9eb1e2c-5612-4cf5-ad3f-fcf7837862a4 req-4c919a46-38af-488f-b460-464cbd4c3153 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.86 "DELETE /v2.0/ports/116218b4-72d9-40d7-bcaf-24faa7227810 HTTP/1.1" status: 204 len: 173 time: 0.4921367 Nov 12 14:58:28.276967 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '79a36c2e-a840-40bd-aaf3-6b40146ff2c5', 'name': 'network-vif-deleted', 'tag': '116218b4-72d9-40d7-bcaf-24faa7227810'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:58:28.280074 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17698757-b186-4823-b5da-7ca48501e1c0" -d '{"events": [{"server_uuid": "79a36c2e-a840-40bd-aaf3-6b40146ff2c5", "name": "network-vif-deleted", "tag": "116218b4-72d9-40d7-bcaf-24faa7227810"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:58:28.325245 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:58:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23226de0-68ae-425f-961e-1d3755252ca1 x-openstack-request-id: req-23226de0-68ae-425f-961e-1d3755252ca1 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:58:28.325546 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "79a36c2e-a840-40bd-aaf3-6b40146ff2c5", "name": "network-vif-deleted", "tag": "116218b4-72d9-40d7-bcaf-24faa7227810", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:58:28.325799 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-23226de0-68ae-425f-961e-1d3755252ca1 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:58:28.326199 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '79a36c2e-a840-40bd-aaf3-6b40146ff2c5', 'name': 'network-vif-deleted', 'tag': '116218b4-72d9-40d7-bcaf-24faa7227810', 'status': 'completed', 'code': 200} Nov 12 14:58:28.543753 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801b4dcf-8507-4e96-8ea9-7e2929781adf req-7b4dbec4-fa8c-4ca9-a942-e564fc361aba tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:28.545281 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-801b4dcf-8507-4e96-8ea9-7e2929781adf req-7b4dbec4-fa8c-4ca9-a942-e564fc361aba tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0511098 Nov 12 14:58:28.549484 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f54e7e2-5f31-466d-88d1-08193cbb0599 req-c5298898-ada9-432a-bad8-97c30f4d5aa1 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:28.550943 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0f54e7e2-5f31-466d-88d1-08193cbb0599 req-c5298898-ada9-432a-bad8-97c30f4d5aa1 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 950 time: 0.0518601 Nov 12 14:58:28.596259 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-801b4dcf-8507-4e96-8ea9-7e2929781adf req-a5d57919-f366-4799-870f-04e379c57407 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448833 Nov 12 14:58:28.597389 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0f54e7e2-5f31-466d-88d1-08193cbb0599 req-a5e7a658-975d-4d67-a102-088d9b4bb0c3 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403795 Nov 12 14:58:29.360128 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2289fb-79e7-40c9-9091-f7035b8265a8 req-4b55fd44-5c36-4672-9739-1f452be92a2a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:29.361480 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6f2289fb-79e7-40c9-9091-f7035b8265a8 req-4b55fd44-5c36-4672-9739-1f452be92a2a tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0471761 Nov 12 14:58:29.413782 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6f2289fb-79e7-40c9-9091-f7035b8265a8 req-eb4f36f4-adb1-48cd-8975-c8102b4e7193 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464141 Nov 12 14:58:29.715088 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df48b8b-13b1-44a1-a421-a0bebdc66e2e req-39ae4260-7123-4c09-928b-af872550fce7 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:29.716592 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6df48b8b-13b1-44a1-a421-a0bebdc66e2e req-39ae4260-7123-4c09-928b-af872550fce7 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 950 time: 0.0510576 Nov 12 14:58:29.716762 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c253f415-ae3f-497d-8996-d5670e7eef4c req-6865ff93-e987-451f-89de-82b7577880a4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:29.718124 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c253f415-ae3f-497d-8996-d5670e7eef4c req-6865ff93-e987-451f-89de-82b7577880a4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0519736 Nov 12 14:58:29.765626 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6df48b8b-13b1-44a1-a421-a0bebdc66e2e req-df9ec420-f339-4bfb-b8ba-e3ecac2e5649 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/security-groups?id=36120496-522a-47cf-84fe-9afc98af94d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431271 Nov 12 14:58:29.950687 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c253f415-ae3f-497d-8996-d5670e7eef4c req-cc02709d-35ce-4576-a7f9-7b62f7adcaa2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2265971 Nov 12 14:58:30.336445 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceb2429e-ef61-4f98-b146-934235d720ab req-52beb712-1559-4f6f-829b-1fe066569dfd tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:30.337798 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ceb2429e-ef61-4f98-b146-934235d720ab req-52beb712-1559-4f6f-829b-1fe066569dfd tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.86 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 950 time: 0.0477650 Nov 12 14:58:30.436878 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-ceb2429e-ef61-4f98-b146-934235d720ab req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Deleting port a1df3353-626f-4991-915e-2a7614ba41d2 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:58:30.437215 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ceb2429e-ef61-4f98-b146-934235d720ab req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:30.570198 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-ceb2429e-ef61-4f98-b146-934235d720ab req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] For port a1df3353-626f-4991-915e-2a7614ba41d2, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=a1df3353-626f-4991-915e-2a7614ba41d2,segment=NetworkSegment(abab7d4b-dd33-47ea-9ae7-a14276956d50),segment_id=abab7d4b-dd33-47ea-9ae7-a14276956d50)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:30.570552 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ceb2429e-ef61-4f98-b146-934235d720ab req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:30.585966 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-907840c9-8404-4f2c-80db-5baa1c169120 req-58413957-1f98-422a-a96b-fff37a625e39 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:30.587460 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-907840c9-8404-4f2c-80db-5baa1c169120 req-58413957-1f98-422a-a96b-fff37a625e39 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0885015 Nov 12 14:58:30.593673 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-ceb2429e-ef61-4f98-b146-934235d720ab req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Calling delete_port for a1df3353-626f-4991-915e-2a7614ba41d2 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:58:30.685330 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-907840c9-8404-4f2c-80db-5baa1c169120 req-1a3f66bc-afdc-4390-acc3-17896ed71d95 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0897229 Nov 12 14:58:30.756904 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ceb2429e-ef61-4f98-b146-934235d720ab req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:30.769590 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['a1df3353-626f-4991-915e-2a7614ba41d2'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:58:30.788906 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Pushing event deleted for resources: {'Port': ['ID=a1df3353-626f-4991-915e-2a7614ba41d2,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:30.836430 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-ceb2429e-ef61-4f98-b146-934235d720ab req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] No DVR routers for this DVR port a1df3353-626f-4991-915e-2a7614ba41d2 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 14:58:30.840020 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ceb2429e-ef61-4f98-b146-934235d720ab req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:30.843425 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ceb2429e-ef61-4f98-b146-934235d720ab req-169b6f84-03d3-4661-9cbf-4ba651a56283 tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.86 "DELETE /v2.0/ports/a1df3353-626f-4991-915e-2a7614ba41d2 HTTP/1.1" status: 204 len: 173 time: 0.4977257 Nov 12 14:58:30.844027 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7a5bacc-c7bf-49f2-822e-1e9580367329', 'name': 'network-vif-deleted', 'tag': 'a1df3353-626f-4991-915e-2a7614ba41d2'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:58:30.847187 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b8fba73-6ffb-40e3-a105-b4873ab331d7" -d '{"events": [{"server_uuid": "a7a5bacc-c7bf-49f2-822e-1e9580367329", "name": "network-vif-deleted", "tag": "a1df3353-626f-4991-915e-2a7614ba41d2"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:58:30.892553 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1df6cee9-0c42-4fec-b917-154e977aee1f req-52baf45e-6520-49f0-8b50-032b9a8dcafe tempest-VolumesNegativeTest-1818794573 tempest-VolumesNegativeTest-1818794573-project] 10.222.0.61 "GET /v2.0/ports?device_id=a7a5bacc-c7bf-49f2-822e-1e9580367329 HTTP/1.1" status: 200 len: 210 time: 0.0359213 Nov 12 14:58:30.910915 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:58:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e3e2289-b9f4-49d2-8ea7-ad718369f65b x-openstack-request-id: req-0e3e2289-b9f4-49d2-8ea7-ad718369f65b {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:58:30.911224 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a7a5bacc-c7bf-49f2-822e-1e9580367329", "name": "network-vif-deleted", "tag": "a1df3353-626f-4991-915e-2a7614ba41d2", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:58:30.911470 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-0e3e2289-b9f4-49d2-8ea7-ad718369f65b {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:58:30.911864 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7a5bacc-c7bf-49f2-822e-1e9580367329', 'name': 'network-vif-deleted', 'tag': 'a1df3353-626f-4991-915e-2a7614ba41d2', 'status': 'completed', 'code': 200} Nov 12 14:58:31.085898 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23c54aa6-60cc-4138-9e57-972a45c5e976 req-d934772a-c6ea-42f6-8c96-cbf135a873c0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:31.087257 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-23c54aa6-60cc-4138-9e57-972a45c5e976 req-d934772a-c6ea-42f6-8c96-cbf135a873c0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0496044 Nov 12 14:58:31.136766 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-23c54aa6-60cc-4138-9e57-972a45c5e976 req-d41aaebb-03fe-48d1-9f3a-6e52fd9c1702 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424345 Nov 12 14:58:31.258361 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 116218b4-72d9-40d7-bcaf-24faa7227810 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:58:31.282459 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 116218b4-72d9-40d7-bcaf-24faa7227810 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:58:31.282793 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 116218b4-72d9-40d7-bcaf-24faa7227810 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:58:31.804915 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901ee300-3bc1-4d3c-924e-d319a99e683e req-0b1e6a20-2e32-4208-895b-7f4606e687d6 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:31.807214 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-901ee300-3bc1-4d3c-924e-d319a99e683e req-0b1e6a20-2e32-4208-895b-7f4606e687d6 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0521348 Nov 12 14:58:31.858305 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-901ee300-3bc1-4d3c-924e-d319a99e683e req-e843de8e-123a-47ab-982a-5fa764708d1c tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452490 Nov 12 14:58:32.265953 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64779f9-3428-4724-8faf-400988cc4aad req-2720e3a5-864b-4392-b056-0a8820d03633 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:32.267530 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a64779f9-3428-4724-8faf-400988cc4aad req-2720e3a5-864b-4392-b056-0a8820d03633 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0542245 Nov 12 14:58:32.321902 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a64779f9-3428-4724-8faf-400988cc4aad req-af1f33b6-4a12-4d25-95df-2c48fe699b35 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476773 Nov 12 14:58:32.979958 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2b8e95-5728-44f0-8762-1f3054192feb req-29c47a4d-07cb-4a8c-99b0-67df2f72ddec tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:32.981590 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c2b8e95-5728-44f0-8762-1f3054192feb req-29c47a4d-07cb-4a8c-99b0-67df2f72ddec tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0551937 Nov 12 14:58:33.043012 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c2b8e95-5728-44f0-8762-1f3054192feb req-0dd75cfb-37ac-4e28-b973-081a07bf5fc5 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554123 Nov 12 14:58:33.263954 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d2b7f476-dd48-4efe-b149-aad19da5171f details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:58:33.312659 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device a1df3353-626f-4991-915e-2a7614ba41d2 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:58:33.373104 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: a1df3353-626f-4991-915e-2a7614ba41d2 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:58:33.373450 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device a1df3353-626f-4991-915e-2a7614ba41d2 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:58:33.421819 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:33.484169 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00e0720d-5643-4030-a918-9909e0c321ac req-2c134258-98eb-4a3a-90bd-df3295f76487 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:33.485934 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-00e0720d-5643-4030-a918-9909e0c321ac req-2c134258-98eb-4a3a-90bd-df3295f76487 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0781868 Nov 12 14:58:33.554059 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-00e0720d-5643-4030-a918-9909e0c321ac req-ded5b43d-a60c-448c-9559-2ac2c6a4ae5d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0617416 Nov 12 14:58:33.576746 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'port_id': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'mac_address': 'fa:16:3e:67:8f:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 638, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:58:33.617579 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:33.638287 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id d2b7f476-dd48-4efe-b149-aad19da5171f {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:58:33.663644 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:33.669859 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:33.732382 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=6']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:33.815860 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['d2b7f476-dd48-4efe-b149-aad19da5171f'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:58:34.172806 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b49f4fa9-00ac-4482-8bb0-96d4fa436369 req-d1b7dc22-7aab-470a-a968-2cfe21c753e7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:34.175771 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b49f4fa9-00ac-4482-8bb0-96d4fa436369 req-d1b7dc22-7aab-470a-a968-2cfe21c753e7 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0629075 Nov 12 14:58:34.233214 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b49f4fa9-00ac-4482-8bb0-96d4fa436369 req-cc444c8c-23ea-4f42-bc79-980fd9cf9fee tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505528 Nov 12 14:58:34.771070 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc4af3f-e49f-4e5b-817f-3c774c5ea347 req-6ec8fb67-0628-440e-bd5d-4f300818868b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:34.788292 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5bc4af3f-e49f-4e5b-817f-3c774c5ea347 req-6ec8fb67-0628-440e-bd5d-4f300818868b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 944 time: 0.1262279 Nov 12 14:58:34.847630 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5bc4af3f-e49f-4e5b-817f-3c774c5ea347 req-2b0029d1-440d-4e82-aaa7-e45b9493b652 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0580046 Nov 12 14:58:34.944420 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:35.388565 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09f53d5a-a743-48a1-8c1f-82f59855c5a0 req-2a318fbc-b3c6-4888-a15a-a242eea1e1ca tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:35.390145 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-09f53d5a-a743-48a1-8c1f-82f59855c5a0 req-2a318fbc-b3c6-4888-a15a-a242eea1e1ca tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0789731 Nov 12 14:58:35.466342 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-09f53d5a-a743-48a1-8c1f-82f59855c5a0 req-9f44d4b6-d821-4a86-868c-d180888a0430 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646877 Nov 12 14:58:35.980588 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2f9a7f-5f48-4dff-b561-f3af7cb4282b req-809cd6fa-08e2-4339-a323-90da0acc52d0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:35.982337 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3a2f9a7f-5f48-4dff-b561-f3af7cb4282b req-809cd6fa-08e2-4339-a323-90da0acc52d0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 944 time: 0.0540912 Nov 12 14:58:36.047886 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d2b7f476-dd48-4efe-b149-aad19da5171f up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:58:36.052756 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3a2f9a7f-5f48-4dff-b561-f3af7cb4282b req-989acbfe-1b20-48bc-ada0-7ce7404ebbb1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0621274 Nov 12 14:58:36.135631 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port d2b7f476-dd48-4efe-b149-aad19da5171f triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:58:36.136468 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:36.230710 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:36.261773 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:58:36.264721 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e3b6076-2d04-49cd-a399-22da2da904ca" -d '{"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-plugged", "status": "completed", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:58:36.279304 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:36.290278 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:36.325422 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:58:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-806b79a6-c313-492c-b6ad-60eaff424040 x-openstack-request-id: req-806b79a6-c313-492c-b6ad-60eaff424040 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:58:36.325745 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-plugged", "status": "completed", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:58:36.326013 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-806b79a6-c313-492c-b6ad-60eaff424040 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:58:36.326413 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'code': 200} Nov 12 14:58:36.351427 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=7']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:36.611739 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e58e00c4-8ba8-4a3d-8698-be6de484f517 req-f000e321-59c9-4c33-aca9-e722a1a38e31 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:36.616626 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e58e00c4-8ba8-4a3d-8698-be6de484f517 req-f000e321-59c9-4c33-aca9-e722a1a38e31 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0717659 Nov 12 14:58:36.685069 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e58e00c4-8ba8-4a3d-8698-be6de484f517 req-45f0814e-2ce9-4195-bc20-0899c246c294 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650258 Nov 12 14:58:37.190590 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7979b93-6f70-40f0-ae4c-90d4a93fa6b5 req-a9cf9937-467f-4b15-b4c3-0ad73d966c1d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:37.192313 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a7979b93-6f70-40f0-ae4c-90d4a93fa6b5 req-a9cf9937-467f-4b15-b4c3-0ad73d966c1d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0593040 Nov 12 14:58:37.250071 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a7979b93-6f70-40f0-ae4c-90d4a93fa6b5 req-c6398c01-f694-4378-8951-f69d97927b68 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509949 Nov 12 14:58:37.810975 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a1fde5-a376-403a-833c-2544633a93cb req-c5f8d169-b387-4792-b4db-3460bebe1468 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:37.826668 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5a1fde5-a376-403a-833c-2544633a93cb req-c5f8d169-b387-4792-b4db-3460bebe1468 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0754771 Nov 12 14:58:37.887010 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5a1fde5-a376-403a-833c-2544633a93cb req-55c4f641-8a9c-491c-b19b-6c2534ee9f9d tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/security-groups?id=d9774d03-ce85-458c-9d68-d51cdef58799&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546889 Nov 12 14:58:38.431499 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2583f530-009f-4c0d-837f-c3b4242a6190 req-40873105-7523-42ad-a5cd-3ef13e6b80b3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:38.433325 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2583f530-009f-4c0d-837f-c3b4242a6190 req-40873105-7523-42ad-a5cd-3ef13e6b80b3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0862043 Nov 12 14:58:38.437209 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605eae54-aef3-466c-9450-319b0813a147 req-e7845bb9-8c0a-42b4-bb06-df14f04468d8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:38.438707 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-605eae54-aef3-466c-9450-319b0813a147 req-e7845bb9-8c0a-42b4-bb06-df14f04468d8 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.86 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 945 time: 0.0810285 Nov 12 14:58:38.492261 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2583f530-009f-4c0d-837f-c3b4242a6190 req-735fbbfe-75ad-4f77-b627-0324d4055f51 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509393 Nov 12 14:58:38.583166 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-605eae54-aef3-466c-9450-319b0813a147 req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Deleting port c0d8b239-ac45-4bde-b0fd-049dd324ae18 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:58:38.584548 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-605eae54-aef3-466c-9450-319b0813a147 req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:38.708773 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-605eae54-aef3-466c-9450-319b0813a147 req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] For port c0d8b239-ac45-4bde-b0fd-049dd324ae18, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=c0d8b239-ac45-4bde-b0fd-049dd324ae18,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:38.709239 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-605eae54-aef3-466c-9450-319b0813a147 req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:38.739723 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-605eae54-aef3-466c-9450-319b0813a147 req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Calling delete_port for c0d8b239-ac45-4bde-b0fd-049dd324ae18 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:58:38.931048 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-605eae54-aef3-466c-9450-319b0813a147 req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:38.950780 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['c0d8b239-ac45-4bde-b0fd-049dd324ae18'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:58:38.972627 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Pushing event deleted for resources: {'Port': ['ID=c0d8b239-ac45-4bde-b0fd-049dd324ae18,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:39.032871 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-605eae54-aef3-466c-9450-319b0813a147 req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] No DVR routers for this DVR port c0d8b239-ac45-4bde-b0fd-049dd324ae18 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 14:58:39.036843 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-605eae54-aef3-466c-9450-319b0813a147 req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:39.041259 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-605eae54-aef3-466c-9450-319b0813a147 req-ad731665-0b9f-4899-a8a2-12c1c3d9c12e tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.86 "DELETE /v2.0/ports/c0d8b239-ac45-4bde-b0fd-049dd324ae18 HTTP/1.1" status: 204 len: 173 time: 0.5947325 Nov 12 14:58:39.041754 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '50446844-a322-466f-b059-0a36b7993f9e', 'name': 'network-vif-deleted', 'tag': 'c0d8b239-ac45-4bde-b0fd-049dd324ae18'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:58:39.044956 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07a9b9c0-b17e-4751-911c-1a0023d4b2cb" -d '{"events": [{"server_uuid": "50446844-a322-466f-b059-0a36b7993f9e", "name": "network-vif-deleted", "tag": "c0d8b239-ac45-4bde-b0fd-049dd324ae18"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:58:39.102064 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4ac5f60a-500f-4616-8432-8a6fad64108c req-a4a105f9-401c-4cc8-9a7e-e37346396307 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 210 time: 0.0670877 Nov 12 14:58:39.186771 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:58:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b85be6f7-9883-4585-b141-8021c1e69be8 x-openstack-request-id: req-b85be6f7-9883-4585-b141-8021c1e69be8 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:58:39.187228 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "50446844-a322-466f-b059-0a36b7993f9e", "name": "network-vif-deleted", "tag": "c0d8b239-ac45-4bde-b0fd-049dd324ae18", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:58:39.187667 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b85be6f7-9883-4585-b141-8021c1e69be8 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:58:39.188235 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '50446844-a322-466f-b059-0a36b7993f9e', 'name': 'network-vif-deleted', 'tag': 'c0d8b239-ac45-4bde-b0fd-049dd324ae18', 'status': 'completed', 'code': 200} Nov 12 14:58:39.617037 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58710) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:39.656428 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8eac8b2-8e74-4038-8013-83e009f86f1a req-561dbfe7-ea82-4da7-84ae-9958efb28540 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:39.665250 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a8eac8b2-8e74-4038-8013-83e009f86f1a req-561dbfe7-ea82-4da7-84ae-9958efb28540 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0799954 Nov 12 14:58:39.736696 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a8eac8b2-8e74-4038-8013-83e009f86f1a req-09aaee20-0771-42d1-a4f2-30add35838d3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0697017 Nov 12 14:58:39.801658 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-8a5b7962-7a7e-4e89-93db-690ab4227f7d admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a285702c576f4ed0b6a5fc2516e70539&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1833313 Nov 12 14:58:39.804534 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58714) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:39.866003 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-284a062f-d99e-421a-a586-f7d582355351 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:39.892924 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-284a062f-d99e-421a-a586-f7d582355351 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:39.958982 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-284a062f-d99e-421a-a586-f7d582355351 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:39.961904 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-284a062f-d99e-421a-a586-f7d582355351 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:39.963757 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-284a062f-d99e-421a-a586-f7d582355351 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/36120496-522a-47cf-84fe-9afc98af94d5 HTTP/1.1" status: 204 len: 168 time: 0.1581366 Nov 12 14:58:39.976704 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-284a062f-d99e-421a-a586-f7d582355351 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36120496-522a-47cf-84fe-9afc98af94d5,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:40.265852 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e1f5f7c0-7a8b-46f2-b829-8a14437ac4c4 req-d3064721-a5f2-4961-b916-3aac923448d5 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 210 time: 0.0465271 Nov 12 14:58:40.905641 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91e7db20-76f0-45f6-babf-7ed759661156 req-af68f68c-3859-43c9-b2d2-1bba2b1a4cbc tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:40.907254 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-91e7db20-76f0-45f6-babf-7ed759661156 req-af68f68c-3859-43c9-b2d2-1bba2b1a4cbc tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0921743 Nov 12 14:58:40.974767 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-91e7db20-76f0-45f6-babf-7ed759661156 req-e3f839b3-b1c9-4d4d-a0d5-a1d764949025 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0603507 Nov 12 14:58:41.426674 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1bec2fed-746d-4bf4-85fe-6844dca82e2d req-1a6e039d-4912-4960-a448-659144a89158 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 210 time: 0.0472517 Nov 12 14:58:41.667029 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device c0d8b239-ac45-4bde-b0fd-049dd324ae18 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:58:41.697827 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: c0d8b239-ac45-4bde-b0fd-049dd324ae18 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:58:41.698454 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device c0d8b239-ac45-4bde-b0fd-049dd324ae18 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:58:42.125094 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68d88a0e-90e0-499a-a4f8-fca17ea46226 req-88a018b0-7bac-41b1-829b-c563c3b7d858 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:42.126859 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-68d88a0e-90e0-499a-a4f8-fca17ea46226 req-88a018b0-7bac-41b1-829b-c563c3b7d858 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0696750 Nov 12 14:58:42.196380 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-68d88a0e-90e0-499a-a4f8-fca17ea46226 req-705943a0-5d0d-484f-b280-b42cd990b341 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0620549 Nov 12 14:58:42.561736 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7e16d69a-646b-407b-ac17-70c319a1a7d3 req-2b5da657-8f0f-46fb-ba69-77401fa34589 tempest-ServerRescueNegativeTestJSON-424009985 tempest-ServerRescueNegativeTestJSON-424009985-project] 10.222.0.61 "GET /v2.0/ports?device_id=50446844-a322-466f-b059-0a36b7993f9e HTTP/1.1" status: 200 len: 210 time: 0.0352600 Nov 12 14:58:43.374076 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39bd5ddb-6577-49e9-b201-5bcd84ff0ef4 req-f5d2bf9f-ba99-42da-a332-e978a51d9d4f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:43.375638 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-39bd5ddb-6577-49e9-b201-5bcd84ff0ef4 req-f5d2bf9f-ba99-42da-a332-e978a51d9d4f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0654058 Nov 12 14:58:43.448348 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-39bd5ddb-6577-49e9-b201-5bcd84ff0ef4 req-7682ff9f-e5ad-462c-888d-5411495e41c4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0661807 Nov 12 14:58:43.631586 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58758) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:44.210099 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1754847'] for router_interface, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:44.639285 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81e1e45-1cfb-48c7-9825-cf01d3881271 req-0a0ead50-683e-40db-af41-cf3a246b2f45 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:44.640904 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d81e1e45-1cfb-48c7-9825-cf01d3881271 req-0a0ead50-683e-40db-af41-cf3a246b2f45 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.1052108 Nov 12 14:58:44.679525 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Deleting port e96e55d4-96d9-437e-bca4-339bc79c6188 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:58:44.679854 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:44.748210 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d81e1e45-1cfb-48c7-9825-cf01d3881271 req-847b65cc-97f6-4bc0-baa1-2e4b7813f4ba tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0996869 Nov 12 14:58:44.791440 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] For port e96e55d4-96d9-437e-bca4-339bc79c6188, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=e96e55d4-96d9-437e-bca4-339bc79c6188,segment=NetworkSegment(38b1dcbf-888a-4fe0-aecf-902b01be2bc6),segment_id=38b1dcbf-888a-4fe0-aecf-902b01be2bc6)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:44.791821 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:44.806480 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Calling delete_port for e96e55d4-96d9-437e-bca4-339bc79c6188 owned by network:router_interface {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:58:45.023143 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:45.069006 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Pushing event deleted for resources: {'Port': ['ID=e96e55d4-96d9-437e-bca4-339bc79c6188,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:45.238439 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611175', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1753199'] for router_interface, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:45.463212 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Router 987f2aa3-654a-4bf7-92e0-07095fb78d18 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 14:58:45.804781 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:58:45.810450 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e5bb4c82-c128-43a7-906d-f6b0f22e20dd admin admin] 10.222.0.61 "PUT /v2.0/routers/987f2aa3-654a-4bf7-92e0-07095fb78d18/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1777291 Nov 12 14:58:45.813775 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58784) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:45.820450 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] Sync routers for ids ['987f2aa3-654a-4bf7-92e0-07095fb78d18'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:58:45.844779 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] Routers {'987f2aa3-654a-4bf7-92e0-07095fb78d18'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:58:45.845808 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:58:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['987f2aa3-654a-4bf7-92e0-07095fb78d18'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:45.888308 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-181068bd-826f-4d65-af4f-10b1700fdfb0 req-81885586-1261-4c8c-ab1b-b9a931182618 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:45.899414 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-181068bd-826f-4d65-af4f-10b1700fdfb0 req-81885586-1261-4c8c-ab1b-b9a931182618 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0637143 Nov 12 14:58:45.948225 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks [] for router, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:45.948843 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-181068bd-826f-4d65-af4f-10b1700fdfb0 req-0ca9bf98-53b6-4d92-af68-bde368ef2c1e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0518992 Nov 12 14:58:45.961707 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] Set router 987f2aa3-654a-4bf7-92e0-07095fb78d18 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:58:46.073857 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.128234 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Deleting port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:58:46.128726 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.145846 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138'}], 'enable_snat': True}, 'gw_port_id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:55Z', 'updated_at': '2021-11-12T14:58:44Z', 'revision_number': 5, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'gw_port': {'id': '318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:31:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.138', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:46.221884 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] For port 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:46.222173 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.238364 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Calling delete_port for 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 owned by network:router_gateway {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:58:46.261248 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] Checking router: 987f2aa3-654a-4bf7-92e0-07095fb78d18 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:58:46.270889 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] Routers {'987f2aa3-654a-4bf7-92e0-07095fb78d18'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:58:46.271520 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:58:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['987f2aa3-654a-4bf7-92e0-07095fb78d18'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:46.360085 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] Set router 987f2aa3-654a-4bf7-92e0-07095fb78d18 gateway port host: None {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:58:46.413021 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:55Z', 'updated_at': '2021-11-12T14:58:46Z', 'revision_number': 6, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'gw_port_host': None}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:46.418626 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.444429 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15a16029-191b-48a6-98b1-236cbcbd4bf4 None None] The sync data for ids ['987f2aa3-654a-4bf7-92e0-07095fb78d18'] in dv-cinder-776422-5-iscsi is: [{'id': '987f2aa3-654a-4bf7-92e0-07095fb78d18', 'name': 'tempest-ServerRescueNegativeTestJSON-521639591-router', 'tenant_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:55Z', 'updated_at': '2021-11-12T14:58:46Z', 'revision_number': 6, 'project_id': '2040ee65b5fa46299ec3a2b82d7464ff', 'gw_port_host': None}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:58:46.451455 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Pushing event deleted for resources: {'Port': ['ID=318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:46.515637 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1760149'] for router_gateway, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.624963 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1755136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-43439'] for router, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.627462 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.697922 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1755257'] for router, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.698295 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Fanout notify agent at l3_agent the message router_deleted on router 987f2aa3-654a-4bf7-92e0-07095fb78d18 {{(pid=101617) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 12 14:58:46.704492 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] Publish callbacks [] for router, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.705642 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-b3463715-ac72-4b6c-b187-65c23857a7ac admin admin] 10.222.0.61 "DELETE /v2.0/routers/987f2aa3-654a-4bf7-92e0-07095fb78d18 HTTP/1.1" status: 204 len: 168 time: 0.8915939 Nov 12 14:58:46.708225 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58792) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:46.755810 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-a5e352df-164b-4a86-be36-fb82b9a4710c admin admin] Deleting subnet 03d9b81e-6504-49f1-9d77-32a1bea3505d {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 14:58:46.759021 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5e352df-164b-4a86-be36-fb82b9a4710c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.797834 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5e352df-164b-4a86-be36-fb82b9a4710c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.846427 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5e352df-164b-4a86-be36-fb82b9a4710c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.914652 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5e352df-164b-4a86-be36-fb82b9a4710c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.928490 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device e96e55d4-96d9-437e-bca4-339bc79c6188 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:58:46.946299 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5e352df-164b-4a86-be36-fb82b9a4710c admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:46.950126 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-a5e352df-164b-4a86-be36-fb82b9a4710c admin admin] 10.222.0.61 "DELETE /v2.0/subnets/03d9b81e-6504-49f1-9d77-32a1bea3505d HTTP/1.1" status: 204 len: 168 time: 0.2409441 Nov 12 14:58:46.951464 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5e352df-164b-4a86-be36-fb82b9a4710c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=03d9b81e-6504-49f1-9d77-32a1bea3505d,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:46.952825 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 58796) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:46.965101 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: e96e55d4-96d9-437e-bca4-339bc79c6188 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:58:46.965407 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device e96e55d4-96d9-437e-bca4-339bc79c6188 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:58:47.037354 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.084589 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0053cb34-94ef-4bc4-8147-1a0e9570537b req-f332b955-cbdf-45d7-8a1c-5d966225180a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:47.086278 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0053cb34-94ef-4bc4-8147-1a0e9570537b req-f332b955-cbdf-45d7-8a1c-5d966225180a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0531311 Nov 12 14:58:47.129417 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.142847 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0053cb34-94ef-4bc4-8147-1a0e9570537b req-2a9866fb-e3cb-4099-a7cf-2a27a17a7a9e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492132 Nov 12 14:58:47.154352 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce']}} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:47.166905 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '38b1dcbf-888a-4fe0-aecf-902b01be2bc6') {'for_net_delete': True} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:47.167199 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '38b1dcbf-888a-4fe0-aecf-902b01be2bc6') {} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:58:47.179448 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4359949'] for segment, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.197586 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.205395 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] Releasing vlan 619 on physical network physnet1 to pool {{(pid=101618) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 14:58:47.205993 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5822932'] for segment, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: Traceback (most recent call last): Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: timer() Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: cb(*args, **kw) Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: return func(*args, **kwargs) Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: self._notify() Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: self.callback(batched_events) Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: event.method(event) Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: return f(self, *a, **k) Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._get(url).json() Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: return self.request(url, 'GET', **kwargs) Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 14:58:47.208412 dv-cinder-776422-5-iscsi neutron-server[101618]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 14:58:47.269703 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.278518 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.285192 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] 10.222.0.61 "DELETE /v2.0/networks/6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce HTTP/1.1" status: 204 len: 168 time: 0.3280258 Nov 12 14:58:47.293405 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-971b2d12-249f-4641-ba46-720dc432891b admin admin] Pushing event deleted for resources: {'Network': ['ID=6b5ba4dc-482d-41d3-9a9b-d2ffb20ea0ce,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:47.489835 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58802) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:47.520415 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d221d-9456-4a01-be26-48b382ccc456 req-eef90889-1dc3-452a-9797-4c6644dd416e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:47.522001 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-088d221d-9456-4a01-be26-48b382ccc456 req-eef90889-1dc3-452a-9797-4c6644dd416e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 1098 time: 0.0516379 Nov 12 14:58:47.534528 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-a5c8d4d9-2eeb-4503-920c-145a056276ba admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=2040ee65b5fa46299ec3a2b82d7464ff&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0432758 Nov 12 14:58:47.537134 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58804) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:47.600320 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9aa73962-a478-4a75-9d3a-3d9c0643df88 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.618072 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9aa73962-a478-4a75-9d3a-3d9c0643df88 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.631590 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d221d-9456-4a01-be26-48b382ccc456 req-af30285c-774e-44d7-b7cb-6f156a85fd59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:47.633224 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-088d221d-9456-4a01-be26-48b382ccc456 req-af30285c-774e-44d7-b7cb-6f156a85fd59 service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.1021085 Nov 12 14:58:47.685164 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9aa73962-a478-4a75-9d3a-3d9c0643df88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.688536 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9aa73962-a478-4a75-9d3a-3d9c0643df88 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:47.689949 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-9aa73962-a478-4a75-9d3a-3d9c0643df88 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/d9774d03-ce85-458c-9d68-d51cdef58799 HTTP/1.1" status: 204 len: 168 time: 0.1519070 Nov 12 14:58:47.699882 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aa73962-a478-4a75-9d3a-3d9c0643df88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9774d03-ce85-458c-9d68-d51cdef58799,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:47.741316 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-088d221d-9456-4a01-be26-48b382ccc456 req-912309d1-d948-47d1-af2e-cb9722aea624 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d2b7f476-dd48-4efe-b149-aad19da5171f HTTP/1.1" status: 200 len: 1001 time: 0.0949020 Nov 12 14:58:47.810888 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d221d-9456-4a01-be26-48b382ccc456 req-c4ad4ae1-b494-4d1d-9f11-e6729fa523aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:47.812881 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-088d221d-9456-4a01-be26-48b382ccc456 req-c4ad4ae1-b494-4d1d-9f11-e6729fa523aa service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0616286 Nov 12 14:58:47.823080 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3029b0d0-66cb-4a2c-a90a-3fa3254079b6 req-f81c8005-8244-4cfe-b114-611a73bda8e3 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:47.824807 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3029b0d0-66cb-4a2c-a90a-3fa3254079b6 req-f81c8005-8244-4cfe-b114-611a73bda8e3 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0530930 Nov 12 14:58:47.866283 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088d221d-9456-4a01-be26-48b382ccc456 req-3b6d9e13-e218-415b-b96f-8f7cae2f1899 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:47.867793 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-088d221d-9456-4a01-be26-48b382ccc456 req-3b6d9e13-e218-415b-b96f-8f7cae2f1899 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0469403 Nov 12 14:58:47.881342 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3029b0d0-66cb-4a2c-a90a-3fa3254079b6 req-59cbb389-d76e-49c7-a825-8e13219eed41 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484338 Nov 12 14:58:47.974207 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-088d221d-9456-4a01-be26-48b382ccc456 req-d40b488d-71e3-4a9e-a8fa-f4aa363a3da5 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0980875 Nov 12 14:58:48.077823 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-088d221d-9456-4a01-be26-48b382ccc456 req-5ee7fc19-af93-4e93-8140-cf2f05b14418 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0936592 Nov 12 14:58:48.278864 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484fa97d-00c2-4c1a-a788-227a36c7ce95 req-48eb5239-4d0d-475c-b6ff-6e04fae2c80e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:48.280812 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-484fa97d-00c2-4c1a-a788-227a36c7ce95 req-48eb5239-4d0d-475c-b6ff-6e04fae2c80e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0571785 Nov 12 14:58:48.330141 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-484fa97d-00c2-4c1a-a788-227a36c7ce95 req-3aec6108-2ac8-4728-9af2-ae946a466233 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427456 Nov 12 14:58:48.683893 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:58:48.710550 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:58:48.710893 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 318f5d53-252a-4d95-aa3d-a4ed5c7ee5f1 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:58:48.999512 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e784551-6258-4de4-ad78-50b826cab949 req-e0872095-f2f6-497f-a78b-6a1fb443a31d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:49.001065 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1e784551-6258-4de4-ad78-50b826cab949 req-e0872095-f2f6-497f-a78b-6a1fb443a31d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0504942 Nov 12 14:58:49.055702 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1e784551-6258-4de4-ad78-50b826cab949 req-88de2e07-9a6b-4050-bb27-a397a0cb981a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479078 Nov 12 14:58:49.458882 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1efc8184-09c8-4980-967f-764cae7de88b req-15b97c8d-a66b-4d95-aad4-b86ac4aa1c4f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:49.460418 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1efc8184-09c8-4980-967f-764cae7de88b req-15b97c8d-a66b-4d95-aad4-b86ac4aa1c4f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0550365 Nov 12 14:58:49.512952 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1efc8184-09c8-4980-967f-764cae7de88b req-c2ad1ccd-26cf-4892-91e8-8517ffcfaee6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457032 Nov 12 14:58:50.172013 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b63da2e9-d658-4c9a-966d-7cb2fe47926b req-07cf0460-dcc4-4655-ac7f-dc2b1cf4514d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:50.173707 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b63da2e9-d658-4c9a-966d-7cb2fe47926b req-07cf0460-dcc4-4655-ac7f-dc2b1cf4514d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0500219 Nov 12 14:58:50.224817 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b63da2e9-d658-4c9a-966d-7cb2fe47926b req-270d29d0-32b1-4a85-bfe9-d02614554bad tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447824 Nov 12 14:58:50.637355 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-683b506d-659f-4fb7-963c-8affa8e21f67 req-159af3de-7185-4906-85ba-e6241372f360 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:50.638790 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-683b506d-659f-4fb7-963c-8affa8e21f67 req-159af3de-7185-4906-85ba-e6241372f360 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0485094 Nov 12 14:58:50.696132 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-683b506d-659f-4fb7-963c-8affa8e21f67 req-c32afd92-b724-4a6d-90ee-bbe2245badf0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508821 Nov 12 14:58:51.340678 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e5b50d-68dd-4239-bfc5-c78f5723389f req-02e0dfc3-73b3-4dbe-933e-7f39a9678d7b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:51.343479 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c4e5b50d-68dd-4239-bfc5-c78f5723389f req-02e0dfc3-73b3-4dbe-933e-7f39a9678d7b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0509212 Nov 12 14:58:51.391033 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c4e5b50d-68dd-4239-bfc5-c78f5723389f req-743a98d1-8203-466e-939b-de175e3078b3 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427384 Nov 12 14:58:51.448646 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [req-caabe4fd-5b88-4dc0-bd88-26e088bb58a3 req-fb00f3c0-2136-418c-aa70-3a1c7aa4001d service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101618) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:58:51.449648 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-caabe4fd-5b88-4dc0-bd88-26e088bb58a3 req-fb00f3c0-2136-418c-aa70-3a1c7aa4001d service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0064201 Nov 12 14:58:51.652264 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4b6461-db92-41b9-b6c6-4c8e5a56f7a0 req-5b960ba3-7e43-4212-808b-1963aa4d988f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:51.653778 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c4b6461-db92-41b9-b6c6-4c8e5a56f7a0 req-5b960ba3-7e43-4212-808b-1963aa4d988f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 945 time: 0.0544462 Nov 12 14:58:51.705200 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c4b6461-db92-41b9-b6c6-4c8e5a56f7a0 req-a03796a8-20a4-4d95-940d-e30689e0a259 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452325 Nov 12 14:58:51.895518 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d2b7f476-dd48-4efe-b149-aad19da5171f no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:58:51.983341 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.010978 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:58:52.013920 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64c20507-4b98-41d5-9362-e59e62b0cb08" -d '{"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-unplugged", "status": "completed", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:58:52.029161 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:52.035715 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.055087 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58958) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:52.069257 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Fri, 12 Nov 2021 14:58:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac24d92d-18b0-4f75-89a2-c916768e0556 x-openstack-request-id: req-ac24d92d-18b0-4f75-89a2-c916768e0556 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:58:52.069554 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-unplugged", "status": "failed", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f", "code": 422}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:58:52.069811 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-ac24d92d-18b0-4f75-89a2-c916768e0556 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:58:52.070221 dv-cinder-776422-5-iscsi neutron-server[101619]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'code': 422} returned with failed status Nov 12 14:58:52.108403 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=8']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:52.112526 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-588c5adc-bf62-4082-9dd1-d11594fb911c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.199489 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-9c1e7f05-7d97-45b0-a427-0ff0b5d92b95 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1422915 Nov 12 14:58:52.209300 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-720336ec-1197-4c99-848d-51566cddf160 service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101617) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 14:58:52.210386 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-720336ec-1197-4c99-848d-51566cddf160 service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0057735 Nov 12 14:58:52.234934 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 58964) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:52.353221 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f9da9fe0-b6f2-442e-8410-7bde2574fade admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.451928 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f9da9fe0-b6f2-442e-8410-7bde2574fade admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.457208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f9da9fe0-b6f2-442e-8410-7bde2574fade admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.496718 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9da9fe0-b6f2-442e-8410-7bde2574fade admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51af5bbe-0aac-4535-a7a3-a69bffd0735b,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:52.504594 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f9da9fe0-b6f2-442e-8410-7bde2574fade admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a327feff276b4335ab9ea89c7b547237&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2681370 Nov 12 14:58:52.504832 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58976) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:52.557469 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1df52ab-a574-40b1-b407-7c21e8134843 req-d50cdede-6b58-43d2-973b-362e07870ba0 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:52.559038 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b1df52ab-a574-40b1-b407-7c21e8134843 req-d50cdede-6b58-43d2-973b-362e07870ba0 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0937486 Nov 12 14:58:52.583734 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05d8334b-c59b-4cce-82c8-e1184eb60de6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.633799 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05d8334b-c59b-4cce-82c8-e1184eb60de6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.655229 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b1df52ab-a574-40b1-b407-7c21e8134843 req-ea26391b-b709-46d6-bba0-295fb404d1af tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0787237 Nov 12 14:58:52.711405 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05d8334b-c59b-4cce-82c8-e1184eb60de6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.720203 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05d8334b-c59b-4cce-82c8-e1184eb60de6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:52.724246 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-05d8334b-c59b-4cce-82c8-e1184eb60de6 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/51af5bbe-0aac-4535-a7a3-a69bffd0735b HTTP/1.1" status: 204 len: 168 time: 0.2183545 Nov 12 14:58:52.734728 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05d8334b-c59b-4cce-82c8-e1184eb60de6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51af5bbe-0aac-4535-a7a3-a69bffd0735b,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:52.875272 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb84fa14-1192-46e9-be2a-fc7d2fcb9a4e req-1f72f49c-4ba4-4db6-b866-979483cf76a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:52.877257 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-bb84fa14-1192-46e9-be2a-fc7d2fcb9a4e req-1f72f49c-4ba4-4db6-b866-979483cf76a8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0661144 Nov 12 14:58:52.907574 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c2ce3ed-21c9-4dc5-96d4-9a5947aed7d1 req-04c2f36b-9064-4b9f-bb04-bfcc5400c3a1 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:52.909303 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1c2ce3ed-21c9-4dc5-96d4-9a5947aed7d1 req-04c2f36b-9064-4b9f-bb04-bfcc5400c3a1 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 945 time: 0.0604758 Nov 12 14:58:52.945759 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-bb84fa14-1192-46e9-be2a-fc7d2fcb9a4e req-4b62a6f3-1994-4313-bc52-ffb74abb8746 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0593381 Nov 12 14:58:52.968911 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1c2ce3ed-21c9-4dc5-96d4-9a5947aed7d1 req-276468dc-9fb6-483b-8d0a-ccb7ccd849d2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529761 Nov 12 14:58:53.095318 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 58990) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:53.108990 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f0f64e9a-7e88-4d10-85a4-9ecca98e14d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:53.191485 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f0f64e9a-7e88-4d10-85a4-9ecca98e14d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:53.197953 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f0f64e9a-7e88-4d10-85a4-9ecca98e14d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:53.239741 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f0f64e9a-7e88-4d10-85a4-9ecca98e14d4 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=036bfe76c2f84e03807b288a6f76a419&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1433289 Nov 12 14:58:53.240607 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f64e9a-7e88-4d10-85a4-9ecca98e14d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d14823d-000c-48b3-99ff-a686c627b5c9,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:53.242670 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 58992) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:58:53.306609 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b8e1e0ce-6e4f-4a52-8557-88032e55ff61 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:53.332896 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b8e1e0ce-6e4f-4a52-8557-88032e55ff61 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:53.385227 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b8e1e0ce-6e4f-4a52-8557-88032e55ff61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:53.387835 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b8e1e0ce-6e4f-4a52-8557-88032e55ff61 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:53.389082 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b8e1e0ce-6e4f-4a52-8557-88032e55ff61 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/8d14823d-000c-48b3-99ff-a686c627b5c9 HTTP/1.1" status: 204 len: 168 time: 0.1432805 Nov 12 14:58:53.397848 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8e1e0ce-6e4f-4a52-8557-88032e55ff61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d14823d-000c-48b3-99ff-a686c627b5c9,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:53.730478 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43ecd528-5284-4074-b752-0b43ad33b934 req-1edfd748-0dde-4871-97dd-420e45e5b60f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:53.732047 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-1edfd748-0dde-4871-97dd-420e45e5b60f service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562&tenant_id=296b2e6385f04550a366eb21cf48ea40 HTTP/1.1" status: 200 len: 1096 time: 0.0802329 Nov 12 14:58:53.804141 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43ecd528-5284-4074-b752-0b43ad33b934 req-02e25536-25af-418f-82c1-682d7a3dfcf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:53.805612 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-02e25536-25af-418f-82c1-682d7a3dfcf0 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 1096 time: 0.0486305 Nov 12 14:58:53.808860 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eff7a1f-44f1-4008-b8c0-a9bb4c0a8c23 req-d9543a52-b2ae-48c5-b8cd-43e6d5010b4b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:53.810485 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6eff7a1f-44f1-4008-b8c0-a9bb4c0a8c23 req-d9543a52-b2ae-48c5-b8cd-43e6d5010b4b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0575328 Nov 12 14:58:53.865360 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6eff7a1f-44f1-4008-b8c0-a9bb4c0a8c23 req-5af36366-fe4d-407d-b9ec-aaa580dc9113 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484643 Nov 12 14:58:53.906027 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43ecd528-5284-4074-b752-0b43ad33b934 req-30726e22-5f80-4155-b9f3-ac499b292fbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:53.907117 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-30726e22-5f80-4155-b9f3-ac499b292fbc service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.0936377 Nov 12 14:58:54.117967 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f21a95d-1227-4f25-b212-c438d8088f74 req-746c1596-7724-4bac-9c21-3c1c5f430e65 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:54.119639 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7f21a95d-1227-4f25-b212-c438d8088f74 req-746c1596-7724-4bac-9c21-3c1c5f430e65 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 945 time: 0.0568833 Nov 12 14:58:54.179053 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7f21a95d-1227-4f25-b212-c438d8088f74 req-2f68a1df-f7e6-4004-b55e-c4b671572d90 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508072 Nov 12 14:58:54.258998 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-2df7fad7-7552-4426-9260-87f729f7bb46 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d2b7f476-dd48-4efe-b149-aad19da5171f HTTP/1.1" status: 200 len: 999 time: 0.3443944 Nov 12 14:58:54.284758 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f7de43-62ad-40a6-a63a-ed51cc2b7b60 req-a684787e-8de3-48c8-b805-8c315e98d616 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:54.286235 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-03f7de43-62ad-40a6-a63a-ed51cc2b7b60 req-a684787e-8de3-48c8-b805-8c315e98d616 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0795224 Nov 12 14:58:54.357202 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43ecd528-5284-4074-b752-0b43ad33b934 req-6f12040f-414d-4127-bd9f-ac649f2e78c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:54.359006 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-6f12040f-414d-4127-bd9f-ac649f2e78c6 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0926087 Nov 12 14:58:54.380799 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-03f7de43-62ad-40a6-a63a-ed51cc2b7b60 req-79f34668-af65-4f7f-a804-2c12885f47bd tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0739183 Nov 12 14:58:54.447090 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43ecd528-5284-4074-b752-0b43ad33b934 req-c5b95d58-0ad1-43e8-864e-22bedce1ad9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:54.448620 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-c5b95d58-0ad1-43e8-864e-22bedce1ad9c service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0814610 Nov 12 14:58:54.527685 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-3bcd68b4-6766-4415-b0c5-891a7fbc1634 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:54.529204 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-3bcd68b4-6766-4415-b0c5-891a7fbc1634 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.86 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 945 time: 0.1159804 Nov 12 14:58:54.537777 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-477604df-3092-4c63-9f60-b5b2cabea8ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:54.620432 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-b5ff36ae-1ad5-4137-b13e-8bffcf2b8a2b service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1636810 Nov 12 14:58:54.706570 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Deleting port ceb7b586-44d0-4731-bf8d-973537662c03 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:58:54.706934 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:54.790887 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43ecd528-5284-4074-b752-0b43ad33b934 req-98587e26-dfbd-4916-a554-94787bc7f5cd service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1623659 Nov 12 14:58:54.829335 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] For port ceb7b586-44d0-4731-bf8d-973537662c03, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ceb7b586-44d0-4731-bf8d-973537662c03,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:58:54.829695 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:54.845198 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Calling delete_port for ceb7b586-44d0-4731-bf8d-973537662c03 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:58:55.021837 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:55.035151 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['ceb7b586-44d0-4731-bf8d-973537662c03'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:58:55.094507 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Pushing event deleted for resources: {'Port': ['ID=ceb7b586-44d0-4731-bf8d-973537662c03,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:58:55.116498 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1df98a61-529c-4ed2-b4d0-62bd7f58c9c8 req-84bb8352-50f6-4ab0-9b14-f1ef5f8de96e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:55.127439 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1df98a61-529c-4ed2-b4d0-62bd7f58c9c8 req-84bb8352-50f6-4ab0-9b14-f1ef5f8de96e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1500068 Nov 12 14:58:55.141945 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] No DVR routers for this DVR port ceb7b586-44d0-4731-bf8d-973537662c03 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 14:58:55.148424 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:55.153528 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-25a8c07b-3d0b-436d-9453-18585120cb72 req-4de5edb5-a82d-4dc3-9302-cfd43c46f08b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.86 "DELETE /v2.0/ports/ceb7b586-44d0-4731-bf8d-973537662c03 HTTP/1.1" status: 204 len: 173 time: 0.6163464 Nov 12 14:58:55.154073 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ef1c882c-ba88-4910-9c4d-c9bf784a916e', 'name': 'network-vif-deleted', 'tag': 'ceb7b586-44d0-4731-bf8d-973537662c03'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:58:55.157025 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5710cf9d-4f94-4768-bd5d-bf3cc919fa75" -d '{"events": [{"server_uuid": "ef1c882c-ba88-4910-9c4d-c9bf784a916e", "name": "network-vif-deleted", "tag": "ceb7b586-44d0-4731-bf8d-973537662c03"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:58:55.223335 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1df98a61-529c-4ed2-b4d0-62bd7f58c9c8 req-adadae21-f002-4789-9e58-5710ca1412f1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0894303 Nov 12 14:58:55.234434 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:58:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0893256-3c33-4084-88d7-dbae57981f3c x-openstack-request-id: req-a0893256-3c33-4084-88d7-dbae57981f3c {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:58:55.234939 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ef1c882c-ba88-4910-9c4d-c9bf784a916e", "name": "network-vif-deleted", "tag": "ceb7b586-44d0-4731-bf8d-973537662c03", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:58:55.235343 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-a0893256-3c33-4084-88d7-dbae57981f3c {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:58:55.236047 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ef1c882c-ba88-4910-9c4d-c9bf784a916e', 'name': 'network-vif-deleted', 'tag': 'ceb7b586-44d0-4731-bf8d-973537662c03', 'status': 'completed', 'code': 200} Nov 12 14:58:55.320417 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f51a3223-1b33-4458-ae9b-8b5082be9f61 req-696340a4-ecb8-43ac-8b0a-6f382f1c9e03 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0405498 Nov 12 14:58:55.543659 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:55.659748 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ec64da-9cae-47f0-b27c-57f451948303 req-604f3857-f742-4562-b419-8227b887edf2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:55.662768 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-28ec64da-9cae-47f0-b27c-57f451948303 req-604f3857-f742-4562-b419-8227b887edf2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.1475010 Nov 12 14:58:55.749505 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-28ec64da-9cae-47f0-b27c-57f451948303 req-bb5d6ade-ac74-4b2e-878a-f341d26c4c93 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0745049 Nov 12 14:58:56.339564 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb7b92f-752c-440a-9b6e-618a2ded21db req-f7240681-2ff7-468d-89fc-7154aeddcd48 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:56.341192 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9fb7b92f-752c-440a-9b6e-618a2ded21db req-f7240681-2ff7-468d-89fc-7154aeddcd48 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0588903 Nov 12 14:58:56.426792 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9fb7b92f-752c-440a-9b6e-618a2ded21db req-fc690e55-b683-42ab-a70d-f3da7fcfd005 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0768332 Nov 12 14:58:56.430062 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-76a1a6e8-460f-4aa1-97e6-818427e204a2 req-5e7805d3-65d7-4f9f-b957-b6e46a94a82a tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0305073 Nov 12 14:58:56.892613 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32fedd67-0992-47d9-8c36-679a8fe273bd req-511701ae-aa76-4da2-9ea1-be962bea0a55 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:56.895066 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-32fedd67-0992-47d9-8c36-679a8fe273bd req-511701ae-aa76-4da2-9ea1-be962bea0a55 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0636828 Nov 12 14:58:56.927157 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:56.969463 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-32fedd67-0992-47d9-8c36-679a8fe273bd req-1752ce72-4b9c-45d6-a693-b6981193683a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0635214 Nov 12 14:58:57.563177 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d6b6c41e-24d8-4c40-b187-6a60c417b8d0 req-35aea9ef-eb77-43dc-8a7c-9417b77985e8 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0317163 Nov 12 14:58:57.573281 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d108314-9956-40bc-b7af-483985d5da35 req-5379be8c-2504-47ef-abdf-0aba17946174 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:57.574826 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0d108314-9956-40bc-b7af-483985d5da35 req-5379be8c-2504-47ef-abdf-0aba17946174 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0706117 Nov 12 14:58:57.639011 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0d108314-9956-40bc-b7af-483985d5da35 req-bc6c7aa6-57e8-460f-b0b6-d5bac22aab95 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542200 Nov 12 14:58:57.900527 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:58:57.923869 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ceb7b586-44d0-4731-bf8d-973537662c03 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:58:57.944511 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: ceb7b586-44d0-4731-bf8d-973537662c03 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:58:57.945258 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ceb7b586-44d0-4731-bf8d-973537662c03 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:58:58.116074 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafed4e7-cf13-4374-b875-927c66c7b042 req-4d04f8ae-3a21-486c-9fd7-37ad37243a61 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:58.117798 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fafed4e7-cf13-4374-b875-927c66c7b042 req-4d04f8ae-3a21-486c-9fd7-37ad37243a61 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0530515 Nov 12 14:58:58.177081 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fafed4e7-cf13-4374-b875-927c66c7b042 req-64230f8b-cf28-40d5-aa1b-3b035cf30b11 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521381 Nov 12 14:58:58.682591 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a0915619-9cea-40e4-b86e-87538ac730cc req-eb66a1dc-9351-443e-8507-0bb1abccda48 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0268357 Nov 12 14:58:58.819552 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47abafbd-d1a7-4878-ac57-d1f92305f846 req-b8da9fc0-ae25-41ef-b2e3-c220fdd5a167 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:58.821217 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-47abafbd-d1a7-4878-ac57-d1f92305f846 req-b8da9fc0-ae25-41ef-b2e3-c220fdd5a167 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0675571 Nov 12 14:58:58.904455 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-47abafbd-d1a7-4878-ac57-d1f92305f846 req-383a6741-c8f5-4b64-88cc-f4eab12e28dd tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0765059 Nov 12 14:58:59.320625 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad88cbc-fe4f-4906-bf03-7007adf5cad8 req-e4c5961c-84b6-4437-967c-ca00bf5808c0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:58:59.322779 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9ad88cbc-fe4f-4906-bf03-7007adf5cad8 req-e4c5961c-84b6-4437-967c-ca00bf5808c0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0542088 Nov 12 14:58:59.379361 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9ad88cbc-fe4f-4906-bf03-7007adf5cad8 req-70c3f6a7-1dcd-40d7-b0a5-3731f86bb5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454252 Nov 12 14:58:59.827279 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-27938275-7f90-45e3-936c-01d25f5baa66 req-5aa461ac-66e3-4820-a855-edd2b92a9a94 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0314996 Nov 12 14:59:00.048702 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63b6522a-623d-4e49-b1bc-6fa52e48eef0 req-8733be81-1927-49a8-8e02-088803ac6440 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:00.048702 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-63b6522a-623d-4e49-b1bc-6fa52e48eef0 req-8733be81-1927-49a8-8e02-088803ac6440 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0587792 Nov 12 14:59:00.109606 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-63b6522a-623d-4e49-b1bc-6fa52e48eef0 req-d3052f97-df8e-474e-9a22-cee16d02bf2a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0539489 Nov 12 14:59:00.511862 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60a083fe-df66-46f1-9d86-e8c72183383c req-4f4615b8-9918-4e73-aeeb-1e25520302bd tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:00.513431 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-60a083fe-df66-46f1-9d86-e8c72183383c req-4f4615b8-9918-4e73-aeeb-1e25520302bd tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0542028 Nov 12 14:59:00.563449 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-60a083fe-df66-46f1-9d86-e8c72183383c req-38134e60-7d42-4481-bae1-f606289d8fef tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438309 Nov 12 14:59:00.939967 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4461ff1e-c316-4f10-b674-afdcdc246df6 req-33dc1ef0-96f5-46c9-b774-ff0aec9d6948 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0261207 Nov 12 14:59:01.249734 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c3d8e61-e522-4d57-af77-f96f0691cd2b req-4f0b8626-eaea-4c1d-9c4f-66d6268e9aa7 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:01.257619 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c3d8e61-e522-4d57-af77-f96f0691cd2b req-4f0b8626-eaea-4c1d-9c4f-66d6268e9aa7 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0636697 Nov 12 14:59:01.307872 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c3d8e61-e522-4d57-af77-f96f0691cd2b req-a5e6d88c-f600-45db-bdf5-ddfe0dd86bb6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490696 Nov 12 14:59:01.706194 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ef292e-3c1c-4d51-871c-d71270bd351a req-2ee57363-8ee3-40be-8a9d-72acafe7ea24 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:01.708867 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-80ef292e-3c1c-4d51-871c-d71270bd351a req-2ee57363-8ee3-40be-8a9d-72acafe7ea24 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0677063 Nov 12 14:59:01.784488 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-80ef292e-3c1c-4d51-871c-d71270bd351a req-97e9437b-b801-4ac0-b70c-0b0dd5a9aa03 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0672078 Nov 12 14:59:02.051189 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-31fc2ee2-5ea9-48e8-b9df-e717a9e1bf89 req-7bb1ace1-48f3-46a6-b8d4-7fbe3a60277e tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0266397 Nov 12 14:59:02.330918 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:59:02.429728 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e58b611-e8d6-4561-ae1e-3f9b9164378a req-4d9d51fe-2f41-43c7-95f2-40905903c17b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:02.431375 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0e58b611-e8d6-4561-ae1e-3f9b9164378a req-4d9d51fe-2f41-43c7-95f2-40905903c17b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0512042 Nov 12 14:59:02.486720 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0e58b611-e8d6-4561-ae1e-3f9b9164378a req-f9ed7d90-0b8a-4ec8-8243-124d9f9e11ea tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491471 Nov 12 14:59:02.913333 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43c27ac-5c47-4db7-9b57-59172a8adf6c req-fca71ae4-e7fe-4f71-bc67-71887628492c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:02.914709 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d43c27ac-5c47-4db7-9b57-59172a8adf6c req-fca71ae4-e7fe-4f71-bc67-71887628492c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0521226 Nov 12 14:59:02.967444 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d43c27ac-5c47-4db7-9b57-59172a8adf6c req-ee469f4a-d1fd-49e0-8739-356e443f9a17 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458765 Nov 12 14:59:03.158612 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bc59828d-e433-4505-a9bf-ab66efd25cae req-41d66386-3ff4-4fa4-ae40-caa9ec18785a tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0271170 Nov 12 14:59:03.632526 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fd2abf4-757e-42c4-8100-451030f4dde4 req-63618dce-95d7-46b4-b79a-e7c882da47d4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:03.635062 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1fd2abf4-757e-42c4-8100-451030f4dde4 req-63618dce-95d7-46b4-b79a-e7c882da47d4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0695856 Nov 12 14:59:03.711208 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1fd2abf4-757e-42c4-8100-451030f4dde4 req-2db1cc43-8adf-4fd2-9372-d9987bf021a7 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0700088 Nov 12 14:59:04.095343 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30e5e6c6-34f5-4717-978d-6cb77e54dd46 req-a13b4ea3-28b4-4653-a544-2aa6d4a57a90 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:04.097065 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30e5e6c6-34f5-4717-978d-6cb77e54dd46 req-a13b4ea3-28b4-4653-a544-2aa6d4a57a90 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0537353 Nov 12 14:59:04.150517 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-30e5e6c6-34f5-4717-978d-6cb77e54dd46 req-aac25633-5987-4145-b23c-0e8d48a97fb4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463021 Nov 12 14:59:04.269830 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8f398da8-1a73-40df-bce2-63b58fbd9b6f req-4650911a-ad5c-4319-8353-f96dd2df6706 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0258839 Nov 12 14:59:04.911367 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6041f560-6209-4f4d-b2e2-413d9a88bc4d req-ea291f27-72b2-400b-a71a-2d7d03859330 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:04.913624 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6041f560-6209-4f4d-b2e2-413d9a88bc4d req-ea291f27-72b2-400b-a71a-2d7d03859330 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1028197 Nov 12 14:59:04.961778 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.015747 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6041f560-6209-4f4d-b2e2-413d9a88bc4d req-dc693afc-4f53-4574-a243-2ab329180327 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0648923 Nov 12 14:59:05.055937 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59184) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:05.170074 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab5bccd9-304b-4a23-851b-e1e51e4e5654 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.255147 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab5bccd9-304b-4a23-851b-e1e51e4e5654 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.262714 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab5bccd9-304b-4a23-851b-e1e51e4e5654 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.306633 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c961a22-d185-40a1-94dd-b1bfd4022a15 req-6105f181-6bd0-487f-9767-94f6143599bf tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:05.307251 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-ab5bccd9-304b-4a23-851b-e1e51e4e5654 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=ecdc006b66424f1ca18f76c466582d0c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2465026 Nov 12 14:59:05.307251 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab5bccd9-304b-4a23-851b-e1e51e4e5654 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=651ffd9f-5119-4d77-b331-cf88b538c58b,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:05.307489 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59192) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:05.311542 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c961a22-d185-40a1-94dd-b1bfd4022a15 req-6105f181-6bd0-487f-9767-94f6143599bf tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0748339 Nov 12 14:59:05.364727 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7c961a22-d185-40a1-94dd-b1bfd4022a15 req-da33f2c8-e74c-44e4-8589-e846b2b5bc08 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521107 Nov 12 14:59:05.365622 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5f536d60-f3be-4a83-bba8-4229ab8870f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.409052 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c6ee1cee-197d-42ef-9c80-6c47813dbaf7 req-3b841f0b-f6d7-48a9-96e5-dea8f83820b4 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef1c882c-ba88-4910-9c4d-c9bf784a916e HTTP/1.1" status: 200 len: 210 time: 0.0398223 Nov 12 14:59:05.413735 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5f536d60-f3be-4a83-bba8-4229ab8870f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.466761 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5f536d60-f3be-4a83-bba8-4229ab8870f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.469446 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5f536d60-f3be-4a83-bba8-4229ab8870f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.470655 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-5f536d60-f3be-4a83-bba8-4229ab8870f6 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/651ffd9f-5119-4d77-b331-cf88b538c58b HTTP/1.1" status: 204 len: 168 time: 0.1619587 Nov 12 14:59:05.478795 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f536d60-f3be-4a83-bba8-4229ab8870f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=651ffd9f-5119-4d77-b331-cf88b538c58b,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:05.749973 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59198) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:05.765261 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-70fee2fc-2af0-45c2-b00f-ee56ea611935 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.898575 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-70fee2fc-2af0-45c2-b00f-ee56ea611935 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.901998 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-0a9d031f-a2a4-4918-8353-8f3b3d7544d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:05.903607 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-0a9d031f-a2a4-4918-8353-8f3b3d7544d7 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 1099 time: 0.0714841 Nov 12 14:59:05.904858 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-70fee2fc-2af0-45c2-b00f-ee56ea611935 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:05.961027 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-70fee2fc-2af0-45c2-b00f-ee56ea611935 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=2727b2726b3847e0947cdbd7c16db371&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2099423 Nov 12 14:59:05.963863 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59200) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:05.974848 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70fee2fc-2af0-45c2-b00f-ee56ea611935 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc9f92e7-2e81-472e-9e67-cb4873b8a17e,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:06.028628 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6b53f4f2-1513-44d0-a92f-b965a50d6661 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:06.048670 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-f940347b-8368-42db-b791-2b8061388532 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.050230 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-f940347b-8368-42db-b791-2b8061388532 service neutron] 10.222.0.86 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 912 time: 0.1168609 Nov 12 14:59:06.053842 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6b53f4f2-1513-44d0-a92f-b965a50d6661 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:06.132366 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-5b131f86-68ef-4f5d-8697-6bb039b2ef8d service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6404f751-2813-4de0-aa94-89a7df49823a HTTP/1.1" status: 200 len: 1000 time: 0.0734236 Nov 12 14:59:06.161816 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6b53f4f2-1513-44d0-a92f-b965a50d6661 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:06.164529 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6b53f4f2-1513-44d0-a92f-b965a50d6661 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:06.166205 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6b53f4f2-1513-44d0-a92f-b965a50d6661 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/bc9f92e7-2e81-472e-9e67-cb4873b8a17e HTTP/1.1" status: 204 len: 168 time: 0.2010012 Nov 12 14:59:06.181385 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae567907-1270-43f6-9361-a773dab9ea61 req-24751285-66ac-4335-8461-3e5153f87ca6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.182961 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ae567907-1270-43f6-9361-a773dab9ea61 req-24751285-66ac-4335-8461-3e5153f87ca6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0700660 Nov 12 14:59:06.189639 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b53f4f2-1513-44d0-a92f-b965a50d6661 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc9f92e7-2e81-472e-9e67-cb4873b8a17e,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:06.193475 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-bf2dc594-c931-40ed-b91f-bdd3a0297fe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.195072 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-bf2dc594-c931-40ed-b91f-bdd3a0297fe0 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 200 len: 850 time: 0.0542819 Nov 12 14:59:06.257423 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ae567907-1270-43f6-9361-a773dab9ea61 req-d4ab826c-d877-4579-baa0-4d28cad8798b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0648048 Nov 12 14:59:06.262093 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-217bee1d-3aff-4134-9e16-765e458ef616 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.262885 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-217bee1d-3aff-4134-9e16-765e458ef616 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0590925 Nov 12 14:59:06.375250 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-980791a5-4d8b-4d35-9243-cfde6cabcb18 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1016972 Nov 12 14:59:06.499012 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-252c53e1-4826-4d5b-8a19-e77875cf22c1 req-aa36aabd-14a4-4ffd-b8ae-0c7da0d0ddfd tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.507988 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-252c53e1-4826-4d5b-8a19-e77875cf22c1 req-aa36aabd-14a4-4ffd-b8ae-0c7da0d0ddfd tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0657799 Nov 12 14:59:06.526972 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5da6ac4-df64-4437-a2df-93886fadb29a req-d9c6b86d-219a-4ce5-85ad-31fd8f5789cf service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1418519 Nov 12 14:59:06.534881 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5854841d-bc82-423d-8242-539f93480d9f req-f7565a45-d103-4de6-909e-c4165c3fac84 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.536369 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5854841d-bc82-423d-8242-539f93480d9f req-f7565a45-d103-4de6-909e-c4165c3fac84 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0786147 Nov 12 14:59:06.581190 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-252c53e1-4826-4d5b-8a19-e77875cf22c1 req-841e561e-98af-4432-8c18-4163fcc52e3f tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0578911 Nov 12 14:59:06.637281 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5854841d-bc82-423d-8242-539f93480d9f req-1b38b21a-4925-4ebb-8454-d58e3075b5c0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0819132 Nov 12 14:59:06.683444 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-a6d3a35a-a9f6-4491-8246-869a6acdcaba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.689630 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-a6d3a35a-a9f6-4491-8246-869a6acdcaba service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 1099 time: 0.0779450 Nov 12 14:59:06.817615 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-b3d1420b-928b-4ce9-a096-e1f16a5154c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.819202 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-b3d1420b-928b-4ce9-a096-e1f16a5154c9 service neutron] 10.222.0.86 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 912 time: 0.1224189 Nov 12 14:59:06.895405 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-aded1436-e7c5-448d-b4fc-d9661096479b service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6404f751-2813-4de0-aa94-89a7df49823a HTTP/1.1" status: 200 len: 1000 time: 0.0673540 Nov 12 14:59:06.948355 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-2d6e4f5e-ae2b-4135-b0ca-b52b8d3aecc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.949806 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-2d6e4f5e-ae2b-4135-b0ca-b52b8d3aecc1 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 200 len: 850 time: 0.0465176 Nov 12 14:59:06.996781 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-7826d22a-749b-485b-a0dd-9b0fb61eb4ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:06.998315 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-7826d22a-749b-485b-a0dd-9b0fb61eb4ac service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0409667 Nov 12 14:59:07.098213 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-1083e592-dd44-4ebf-8a65-32a7a5cacd14 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0905082 Nov 12 14:59:07.719351 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-155e506e-fc3e-4685-8939-3c064bb099f1 req-bf3f5797-ea0b-4d97-bd79-c1b6c759aa03 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:07.721899 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-155e506e-fc3e-4685-8939-3c064bb099f1 req-bf3f5797-ea0b-4d97-bd79-c1b6c759aa03 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0761755 Nov 12 14:59:07.780556 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-155e506e-fc3e-4685-8939-3c064bb099f1 req-2a7c9f77-2a92-474f-9fd7-42efd98aab66 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517750 Nov 12 14:59:07.784625 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e3c555c-a4c6-407d-a61b-1e12c2da856d req-0fa3cda6-d6cb-461b-8009-9d795d2f5066 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:07.786302 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7e3c555c-a4c6-407d-a61b-1e12c2da856d req-0fa3cda6-d6cb-461b-8009-9d795d2f5066 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0540957 Nov 12 14:59:07.851971 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7e3c555c-a4c6-407d-a61b-1e12c2da856d req-079cd5d7-9a75-406c-97b7-b0b2e92706d8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594661 Nov 12 14:59:08.902508 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ddef84e-798f-4e68-9819-d9dd031d8986 req-a8d48f96-445b-4cdd-ac9f-6e17defad459 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:08.904131 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1ddef84e-798f-4e68-9819-d9dd031d8986 req-a8d48f96-445b-4cdd-ac9f-6e17defad459 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0521805 Nov 12 14:59:08.956021 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1ddef84e-798f-4e68-9819-d9dd031d8986 req-b05a24e9-bf1c-4655-8ff7-08669e6dcdec tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457513 Nov 12 14:59:08.982684 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906888ce-8085-46a3-97a9-1fe4f7633707 req-7a2a4d86-83a0-4b8b-b917-cbc4117ed0bf tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:08.984200 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-906888ce-8085-46a3-97a9-1fe4f7633707 req-7a2a4d86-83a0-4b8b-b917-cbc4117ed0bf tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0504966 Nov 12 14:59:09.033569 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-906888ce-8085-46a3-97a9-1fe4f7633707 req-711e28e0-60c5-4843-8c00-4921cd097ae5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434790 Nov 12 14:59:09.815922 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a19b0d34-c8f6-4248-9ce7-5b71e7ed2f31 req-f3d98b94-f298-4afc-b0e4-de743c3b973e service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1174388 Nov 12 14:59:10.096642 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8234803d-919e-4d9a-8245-24641f979bf0 req-8ac18989-0d19-447a-84e0-339c1d55e752 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:10.098255 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8234803d-919e-4d9a-8245-24641f979bf0 req-8ac18989-0d19-447a-84e0-339c1d55e752 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0610220 Nov 12 14:59:10.156204 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8234803d-919e-4d9a-8245-24641f979bf0 req-b85edcb1-4e44-48a9-b4b9-fd94b96480b9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507762 Nov 12 14:59:10.195496 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1431bca3-4b36-4eed-975b-6e76fe648b6c req-44aefd9f-7020-4f31-8098-dfb84c6ce2b3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:10.198745 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1431bca3-4b36-4eed-975b-6e76fe648b6c req-44aefd9f-7020-4f31-8098-dfb84c6ce2b3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0746081 Nov 12 14:59:10.256042 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1431bca3-4b36-4eed-975b-6e76fe648b6c req-bfaa67d5-4a3c-4552-99e7-e350bca4d8c5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506518 Nov 12 14:59:11.289460 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9f1818-ee2a-40a8-906c-3906a2eebb90 req-3ca32335-4d72-40a3-9987-6c79e5f63e41 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:11.291764 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-af9f1818-ee2a-40a8-906c-3906a2eebb90 req-3ca32335-4d72-40a3-9987-6c79e5f63e41 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0647218 Nov 12 14:59:11.354331 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-af9f1818-ee2a-40a8-906c-3906a2eebb90 req-464f13c1-9ca4-4ab0-9211-b9bc69d428b6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567069 Nov 12 14:59:11.413914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-647ad7ad-1814-49c1-a7b3-396033cde300 req-941f84f6-5689-459c-8d1d-d97c981c83c4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:11.415893 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-647ad7ad-1814-49c1-a7b3-396033cde300 req-941f84f6-5689-459c-8d1d-d97c981c83c4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0642111 Nov 12 14:59:11.472055 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-647ad7ad-1814-49c1-a7b3-396033cde300 req-f06f4d53-dd9d-4ce5-97f0-b3b679595e7a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450444 Nov 12 14:59:12.597834 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60291431-d643-4df2-b270-7f193a9d6118 req-b461808c-4bfa-459d-b4ee-8bdcac7e6092 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:12.599251 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-60291431-d643-4df2-b270-7f193a9d6118 req-b461808c-4bfa-459d-b4ee-8bdcac7e6092 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0523427 Nov 12 14:59:12.651659 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-60291431-d643-4df2-b270-7f193a9d6118 req-1a1cbd61-3c07-42be-9ccb-af77b6576db4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453467 Nov 12 14:59:13.774212 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82032b95-367a-4581-bb5d-48f5155eb51c req-5676a887-0ac8-4617-8d95-cb25aac424e8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:13.776585 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-82032b95-367a-4581-bb5d-48f5155eb51c req-5676a887-0ac8-4617-8d95-cb25aac424e8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0510392 Nov 12 14:59:13.825849 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-82032b95-367a-4581-bb5d-48f5155eb51c req-e0ea47a5-8b45-4ec7-94da-81836e11c25e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428693 Nov 12 14:59:14.950495 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a02c8040-80c8-4812-9e43-37405679be5b req-870be7f9-58ea-449a-beb3-bc0402f6a8fb tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:14.951886 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a02c8040-80c8-4812-9e43-37405679be5b req-870be7f9-58ea-449a-beb3-bc0402f6a8fb tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0484798 Nov 12 14:59:15.000926 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a02c8040-80c8-4812-9e43-37405679be5b req-7abc0e06-a15f-407b-b4cd-3d24e6f71458 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427284 Nov 12 14:59:15.672688 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-3e2bcc2c-f8c6-4626-be2b-8e087f4cca70 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:15.674078 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-3e2bcc2c-f8c6-4626-be2b-8e087f4cca70 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/networks?id=52b14bae-7f5f-4554-a082-87deb1ef1096 HTTP/1.1" status: 200 len: 814 time: 0.1108165 Nov 12 14:59:15.689182 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-6da24ee9-021a-4e19-8a2c-9eacafcf9142 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/quotas/71f7babcbb2e48a899f3b931fbcb2c03 HTTP/1.1" status: 200 len: 375 time: 0.0092332 Nov 12 14:59:15.722825 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-2a4ed8a9-5898-473e-b5d6-abfbb1166aa4 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=71f7babcbb2e48a899f3b931fbcb2c03&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0272913 Nov 12 14:59:15.817374 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-77962fee-d16d-459b-bab0-b36d9a8f50a4 service neutron] 10.222.0.61 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866864 Nov 12 14:59:15.908817 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-3cb2ff56-71a0-4da2-878d-768e9ad5afcb service neutron] 10.222.0.61 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847535 Nov 12 14:59:16.087495 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0817aaa8-a127-4655-8da5-96517c22a3ec req-671c1857-a917-4c28-aa96-131cef92b41a tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 210 time: 0.0313139 Nov 12 14:59:16.135543 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52805ae8-dd6c-4c3c-ae99-6dbf443498d1 req-1e9951d8-cd32-4a91-894b-3fcf6fb00442 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:16.137364 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-52805ae8-dd6c-4c3c-ae99-6dbf443498d1 req-1e9951d8-cd32-4a91-894b-3fcf6fb00442 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0574002 Nov 12 14:59:16.190008 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-52805ae8-dd6c-4c3c-ae99-6dbf443498d1 req-a71366fc-713d-4a28-bbc9-8cd1c232d619 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467374 Nov 12 14:59:17.069582 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-1c1a16f3-1013-4a85-b30e-9464fe1ce678 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:17.071595 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-1c1a16f3-1013-4a85-b30e-9464fe1ce678 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.86 "GET /v2.0/networks?id=52b14bae-7f5f-4554-a082-87deb1ef1096 HTTP/1.1" status: 200 len: 814 time: 0.1098797 Nov 12 14:59:17.084857 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Request body: {'port': {'device_id': 'f9f2c3bf-5399-4a09-91e7-f35ca8c02eec', 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096', 'admin_state_up': True, 'tenant_id': '71f7babcbb2e48a899f3b931fbcb2c03'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:59:17.190563 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5af7b284-d682-4afd-923f-12688878e60e req-0397926c-6862-47de-8a3e-30a0eccf7cc4 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 210 time: 0.0300345 Nov 12 14:59:17.214208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Made reservation on behalf of 71f7babcbb2e48a899f3b931fbcb2c03 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:59:17.217815 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:17.367986 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ef26df8-9551-4758-98e1-40887295f16f req-1ccea176-d7b7-41f7-9f56-b93112f69a13 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:17.369565 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7ef26df8-9551-4758-98e1-40887295f16f req-1ccea176-d7b7-41f7-9f56-b93112f69a13 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 943 time: 0.0959158 Nov 12 14:59:17.403809 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Allocated IP 172.20.0.6 (52b14bae-7f5f-4554-a082-87deb1ef1096/e3c6e311-60aa-48d4-9047-fdea4100c035/e866cc64-ce6b-4022-97ab-01c1add377e0) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:59:17.443937 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7ef26df8-9551-4758-98e1-40887295f16f req-854be8c1-6d37-4f18-a3ba-6113fbd68a4f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0664046 Nov 12 14:59:17.587415 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:17.623467 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:17.665897 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Network 52b14bae-7f5f-4554-a082-87deb1ef1096 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:59:17.669494 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:17.675527 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:59:17.702152 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Pushing event updated for resources: {'Port': ['ID=e866cc64-ce6b-4022-97ab-01c1add377e0,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:17.714658 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.714996 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.715324 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.715648 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.715968 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.716312 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.716628 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.716943 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.717253 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.717564 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.717874 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.718184 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:17.742626 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:17.743281 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:17.760012 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-df000ef7-a231-4f86-9529-094eca2930a2 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6789758 Nov 12 14:59:17.773590 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Request body: {'port': {'device_id': 'f9f2c3bf-5399-4a09-91e7-f35ca8c02eec', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:59:17.833463 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:18.062135 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d2b7f476-dd48-4efe-b149-aad19da5171f details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:59:18.098889 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e866cc64-ce6b-4022-97ab-01c1add377e0 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:59:18.107298 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:18.120868 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Transition to ACTIVE for port object e866cc64-ce6b-4022-97ab-01c1add377e0 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 14:59:18.124620 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:18.163021 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:18.173717 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Pushing event updated for resources: {'Port': ['ID=e866cc64-ce6b-4022-97ab-01c1add377e0,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:18.176962 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'port_id': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'mac_address': 'fa:16:3e:67:8f:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 638, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:59:18.218649 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:18.236496 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d2b7f476-dd48-4efe-b149-aad19da5171f {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:59:18.256853 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Attempting to bind port e866cc64-ce6b-4022-97ab-01c1add377e0 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:59:18.257207 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Attempting to bind port e866cc64-ce6b-4022-97ab-01c1add377e0 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '8d885094-f225-46f0-a8f7-af9d90c9da56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:59:18.258006 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:18.258128 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Attempting to bind port e866cc64-ce6b-4022-97ab-01c1add377e0 on network 52b14bae-7f5f-4554-a082-87deb1ef1096 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:59:18.262434 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:18.263268 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Port e866cc64-ce6b-4022-97ab-01c1add377e0 on network 52b14bae-7f5f-4554-a082-87deb1ef1096 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 14:59:18.263733 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Attempting to bind port e866cc64-ce6b-4022-97ab-01c1add377e0 on network 52b14bae-7f5f-4554-a082-87deb1ef1096 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:59:18.269181 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 59, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:59:18.269515 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Checking segment: {'id': '8d885094-f225-46f0-a8f7-af9d90c9da56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:59:18.269893 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Bound using segment: {'id': '8d885094-f225-46f0-a8f7-af9d90c9da56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:59:18.270317 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Bound port: e866cc64-ce6b-4022-97ab-01c1add377e0, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8d885094-f225-46f0-a8f7-af9d90c9da56', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 609, 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:59:18.270667 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:18.318907 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=9']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:18.325899 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3c37a42-cc9c-4325-bd4e-50bacdaa525c req-8c07cfdf-0730-4eb2-9f7e-7d8a2d660a9d tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:18.327445 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b3c37a42-cc9c-4325-bd4e-50bacdaa525c req-8c07cfdf-0730-4eb2-9f7e-7d8a2d660a9d tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 943 time: 0.0606778 Nov 12 14:59:18.343379 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] For port e866cc64-ce6b-4022-97ab-01c1add377e0, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:59:18.344823 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] For port e866cc64-ce6b-4022-97ab-01c1add377e0, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=e866cc64-ce6b-4022-97ab-01c1add377e0,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:59:18.350567 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:18.379985 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b3c37a42-cc9c-4325-bd4e-50bacdaa525c req-f29da8bd-128a-4983-99d3-83d89ba0419e tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446160 Nov 12 14:59:18.387088 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:18.387740 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:18.389162 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] 10.222.0.86 "PUT /v2.0/ports/e866cc64-ce6b-4022-97ab-01c1add377e0 HTTP/1.1" status: 200 len: 1093 time: 0.6200211 Nov 12 14:59:18.389608 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9f2c3bf-5399-4a09-91e7-f35ca8c02eec', 'tag': 'e866cc64-ce6b-4022-97ab-01c1add377e0'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:59:18.391886 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bab5300d-a414-4322-b83f-0091f1339541" -d '{"events": [{"name": "network-changed", "server_uuid": "f9f2c3bf-5399-4a09-91e7-f35ca8c02eec", "tag": "e866cc64-ce6b-4022-97ab-01c1add377e0"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:59:18.428201 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae8cb104-5014-49b8-9bee-3b50da17abb8 service neutron] Pushing event updated for resources: {'Port': ['ID=e866cc64-ce6b-4022-97ab-01c1add377e0,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:18.451309 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 14:59:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2df87877-48fd-4a70-9ba9-2eb503e36e72 x-openstack-request-id: req-2df87877-48fd-4a70-9ba9-2eb503e36e72 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:59:18.451591 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9f2c3bf-5399-4a09-91e7-f35ca8c02eec", "tag": "e866cc64-ce6b-4022-97ab-01c1add377e0", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:59:18.451838 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-2df87877-48fd-4a70-9ba9-2eb503e36e72 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:59:18.452252 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9f2c3bf-5399-4a09-91e7-f35ca8c02eec', 'tag': 'e866cc64-ce6b-4022-97ab-01c1add377e0', 'status': 'completed', 'code': 200} Nov 12 14:59:18.485036 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-60b1ec2f-f1a0-4bbc-a74b-740eed38e6fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:18.486673 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-60b1ec2f-f1a0-4bbc-a74b-740eed38e6fb service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=71f7babcbb2e48a899f3b931fbcb2c03&device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 1096 time: 0.0468731 Nov 12 14:59:18.507155 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['d2b7f476-dd48-4efe-b149-aad19da5171f'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:59:18.530933 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-63c37ec2-28ad-4483-99a7-5a8c5732dc8a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e866cc64-ce6b-4022-97ab-01c1add377e0 HTTP/1.1" status: 200 len: 217 time: 0.0356376 Nov 12 14:59:18.569366 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4094a4cd-4565-4c98-9790-321b027fdd16 req-a795bd0a-2425-4d71-b84a-f52ce6991b94 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:18.571669 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4094a4cd-4565-4c98-9790-321b027fdd16 req-a795bd0a-2425-4d71-b84a-f52ce6991b94 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 944 time: 0.0515983 Nov 12 14:59:18.594539 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-e195a0a4-84e9-4483-ad71-f56e11eaa628 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:18.596152 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-e195a0a4-84e9-4483-ad71-f56e11eaa628 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e3c6e311-60aa-48d4-9047-fdea4100c035 HTTP/1.1" status: 200 len: 854 time: 0.0571232 Nov 12 14:59:18.623087 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4094a4cd-4565-4c98-9790-321b027fdd16 req-bd7388cc-6e61-4236-a392-4242a6e48eed tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446968 Nov 12 14:59:18.637647 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-5595d364-6517-48bd-8ef8-fbd251709c2a service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=52b14bae-7f5f-4554-a082-87deb1ef1096&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0314097 Nov 12 14:59:18.728632 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-8badab20-ffcb-4cab-977f-6b824341428b service neutron] 10.222.0.86 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831625 Nov 12 14:59:18.825128 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-786d4494-1521-4c6d-9c0a-bbe1241c551e req-685ad9c0-4302-4dd6-a908-b4a4ddef8b2f service neutron] 10.222.0.86 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881989 Nov 12 14:59:18.915830 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab5300d-a414-4322-b83f-0091f1339541 req-0472b04b-cb79-43d7-b4fb-4ac6026ca617 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:18.917326 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bab5300d-a414-4322-b83f-0091f1339541 req-0472b04b-cb79-43d7-b4fb-4ac6026ca617 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=71f7babcbb2e48a899f3b931fbcb2c03&device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 1096 time: 0.0409102 Nov 12 14:59:19.008830 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab5300d-a414-4322-b83f-0091f1339541 req-e907ea84-85e9-4bb5-8d92-d6eb35d9c1c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:19.010278 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bab5300d-a414-4322-b83f-0091f1339541 req-e907ea84-85e9-4bb5-8d92-d6eb35d9c1c4 service neutron] 10.222.0.86 "GET /v2.0/networks?id=52b14bae-7f5f-4554-a082-87deb1ef1096 HTTP/1.1" status: 200 len: 915 time: 0.0838423 Nov 12 14:59:19.056360 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bab5300d-a414-4322-b83f-0091f1339541 req-c01eb3c8-816f-4c48-af35-68efab04b7f7 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e866cc64-ce6b-4022-97ab-01c1add377e0 HTTP/1.1" status: 200 len: 217 time: 0.0382948 Nov 12 14:59:19.109847 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab5300d-a414-4322-b83f-0091f1339541 req-095c6734-02b1-4b4a-a8c5-8a94f17be371 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:19.111286 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bab5300d-a414-4322-b83f-0091f1339541 req-095c6734-02b1-4b4a-a8c5-8a94f17be371 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e3c6e311-60aa-48d4-9047-fdea4100c035 HTTP/1.1" status: 200 len: 854 time: 0.0447156 Nov 12 14:59:19.144350 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bab5300d-a414-4322-b83f-0091f1339541 req-b5ad3a1b-780b-4ecf-88da-46ade6318908 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=52b14bae-7f5f-4554-a082-87deb1ef1096&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0241635 Nov 12 14:59:19.236546 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bab5300d-a414-4322-b83f-0091f1339541 req-d5c65045-f447-4f5b-a730-0631c0c747f0 service neutron] 10.222.0.86 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848083 Nov 12 14:59:19.328520 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bab5300d-a414-4322-b83f-0091f1339541 req-b9e03ed6-c04b-4d19-9241-2915bceae129 service neutron] 10.222.0.86 "GET /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849366 Nov 12 14:59:19.528341 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57977b2d-c294-49bd-a6ba-1af204e094d1 req-b3445ebb-ebf1-47db-a919-f554cda94323 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:19.529925 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-57977b2d-c294-49bd-a6ba-1af204e094d1 req-b3445ebb-ebf1-47db-a919-f554cda94323 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 943 time: 0.0640950 Nov 12 14:59:19.764770 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3604ad7-f051-468c-ad65-6fc03df8ebef req-6cb19126-18ba-44a3-9bae-2ff7289d1371 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:19.766354 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e3604ad7-f051-468c-ad65-6fc03df8ebef req-6cb19126-18ba-44a3-9bae-2ff7289d1371 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 944 time: 0.0584373 Nov 12 14:59:19.823978 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e3604ad7-f051-468c-ad65-6fc03df8ebef req-84021ade-52b6-499f-8230-a41bd8ceef7f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508373 Nov 12 14:59:19.836972 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-57977b2d-c294-49bd-a6ba-1af204e094d1 req-e752005e-3b47-492d-9bbf-c4684659f8cd tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3009145 Nov 12 14:59:20.074557 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d2b7f476-dd48-4efe-b149-aad19da5171f up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:59:20.124606 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port d2b7f476-dd48-4efe-b149-aad19da5171f triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:20.124986 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:20.202536 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:20.225104 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:59:20.227376 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e9b967c-17c2-4f06-b028-f11b3df91d6b" -d '{"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-plugged", "status": "completed", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:59:20.243912 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:20.249158 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:20.272143 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:59:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3d571d88-e779-4391-9848-eb71b7cc99cf x-openstack-request-id: req-3d571d88-e779-4391-9848-eb71b7cc99cf {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:59:20.272462 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-plugged", "status": "completed", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:59:20.272717 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-3d571d88-e779-4391-9848-eb71b7cc99cf {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:59:20.273108 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'code': 200} Nov 12 14:59:20.298389 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=10']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:20.706951 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c1a8bfa-9f6a-45f7-97f8-6c33f663c671 req-5a957074-2e60-418c-87e6-6b88765d04ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:20.708869 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7c1a8bfa-9f6a-45f7-97f8-6c33f663c671 req-5a957074-2e60-418c-87e6-6b88765d04ad service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 1099 time: 0.0422053 Nov 12 14:59:20.756608 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7c1a8bfa-9f6a-45f7-97f8-6c33f663c671 req-ebce2953-3e36-40de-9866-fc5f73e4cf25 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388713 Nov 12 14:59:20.946566 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da832cff-7dfa-4454-b0f9-9b9133ce16cd req-df4e0e38-99b9-4024-b158-82a88ac48dfa tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:20.947982 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-da832cff-7dfa-4454-b0f9-9b9133ce16cd req-df4e0e38-99b9-4024-b158-82a88ac48dfa tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 946 time: 0.0488386 Nov 12 14:59:20.954160 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c750778-26ca-4d9a-81a1-9cd26d3d0076 req-1858cd3f-617e-4e07-91e3-6ae1c0e36932 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:20.955640 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4c750778-26ca-4d9a-81a1-9cd26d3d0076 req-1858cd3f-617e-4e07-91e3-6ae1c0e36932 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 943 time: 0.0483806 Nov 12 14:59:20.999336 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-da832cff-7dfa-4454-b0f9-9b9133ce16cd req-44913e03-ede2-4346-afa8-2fd883b461eb tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453413 Nov 12 14:59:21.008776 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4c750778-26ca-4d9a-81a1-9cd26d3d0076 req-c071ffcb-b02a-40c3-9d4c-4d74bfa22445 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464694 Nov 12 14:59:22.108441 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device e866cc64-ce6b-4022-97ab-01c1add377e0 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 14:59:22.116457 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3c1114cd-ea09-4c8a-8d9f-f8955d3fb579 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:22.162653 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a707eea-68d4-46a2-9342-97fe8faa40b4 req-ffa37be0-90b0-40b4-be9d-bd23e84e2bbf tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:22.164295 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1a707eea-68d4-46a2-9342-97fe8faa40b4 req-ffa37be0-90b0-40b4-be9d-bd23e84e2bbf tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 943 time: 0.0664225 Nov 12 14:59:22.191704 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c202df8f-6490-413f-84f9-e8be76731e85 req-fe7c3363-e937-48e5-985c-049ab23430db tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:22.193675 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c202df8f-6490-413f-84f9-e8be76731e85 req-fe7c3363-e937-48e5-985c-049ab23430db tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 946 time: 0.0833325 Nov 12 14:59:22.267266 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1a707eea-68d4-46a2-9342-97fe8faa40b4 req-857c5ac1-1965-4609-95ac-9f2c9379cb79 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820749 Nov 12 14:59:22.268676 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port e866cc64-ce6b-4022-97ab-01c1add377e0, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=e866cc64-ce6b-4022-97ab-01c1add377e0,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:22.277064 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c202df8f-6490-413f-84f9-e8be76731e85 req-e251f96c-ac42-4a25-bc2a-fd65ebd7f63b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0730712 Nov 12 14:59:22.287685 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'e866cc64-ce6b-4022-97ab-01c1add377e0', 'network_id': '52b14bae-7f5f-4554-a082-87deb1ef1096', 'port_id': 'e866cc64-ce6b-4022-97ab-01c1add377e0', 'mac_address': 'fa:16:3e:d9:bb:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 609, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e3c6e311-60aa-48d4-9047-fdea4100c035', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 14:59:22.336312 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:22.355233 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e866cc64-ce6b-4022-97ab-01c1add377e0 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 14:59:22.377658 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port e866cc64-ce6b-4022-97ab-01c1add377e0, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=e866cc64-ce6b-4022-97ab-01c1add377e0,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:22.381953 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:22.440436 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=e866cc64-ce6b-4022-97ab-01c1add377e0,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:22.635580 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['e866cc64-ce6b-4022-97ab-01c1add377e0'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:59:23.364015 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a17b46-60f3-469b-8468-784d5e3cbfe1 req-8656e6d2-80dc-4bf0-8a0b-072feb67e029 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:23.365519 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c4a17b46-60f3-469b-8468-784d5e3cbfe1 req-8656e6d2-80dc-4bf0-8a0b-072feb67e029 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 944 time: 0.0491989 Nov 12 14:59:23.409052 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2402a0-dbf7-42e9-a62b-b5d553c594ab req-77c1cea1-d79e-4e6c-8e51-53df4c84ddf3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:23.410563 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa2402a0-dbf7-42e9-a62b-b5d553c594ab req-77c1cea1-d79e-4e6c-8e51-53df4c84ddf3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 946 time: 0.0494909 Nov 12 14:59:23.416855 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c4a17b46-60f3-469b-8468-784d5e3cbfe1 req-da71dcb3-1e94-42c5-bb59-4fe80c53898b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447986 Nov 12 14:59:23.460527 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa2402a0-dbf7-42e9-a62b-b5d553c594ab req-f8b06129-5f0c-4723-9e63-0fdfeb57c4f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429983 Nov 12 14:59:24.117624 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device e866cc64-ce6b-4022-97ab-01c1add377e0 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:59:24.167654 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port e866cc64-ce6b-4022-97ab-01c1add377e0 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 14:59:24.171651 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port e866cc64-ce6b-4022-97ab-01c1add377e0 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:24.172028 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:24.252035 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:24.275832 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9f2c3bf-5399-4a09-91e7-f35ca8c02eec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e866cc64-ce6b-4022-97ab-01c1add377e0'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:59:24.278136 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-228af35a-70b5-4070-ab3a-7252e56b08f1" -d '{"events": [{"server_uuid": "f9f2c3bf-5399-4a09-91e7-f35ca8c02eec", "name": "network-vif-plugged", "status": "completed", "tag": "e866cc64-ce6b-4022-97ab-01c1add377e0"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:59:24.290882 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port e866cc64-ce6b-4022-97ab-01c1add377e0, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=e866cc64-ce6b-4022-97ab-01c1add377e0,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:24.295647 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:24.322069 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:59:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8fb83e85-0a56-440d-9c32-f9a29c7b2b5a x-openstack-request-id: req-8fb83e85-0a56-440d-9c32-f9a29c7b2b5a {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:59:24.322354 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9f2c3bf-5399-4a09-91e7-f35ca8c02eec", "name": "network-vif-plugged", "status": "completed", "tag": "e866cc64-ce6b-4022-97ab-01c1add377e0", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:59:24.322601 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-8fb83e85-0a56-440d-9c32-f9a29c7b2b5a {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:59:24.323010 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9f2c3bf-5399-4a09-91e7-f35ca8c02eec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e866cc64-ce6b-4022-97ab-01c1add377e0', 'code': 200} Nov 12 14:59:24.351087 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=e866cc64-ce6b-4022-97ab-01c1add377e0,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:24.358389 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.358732 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.359068 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.359399 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.359724 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.360049 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.360393 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.360742 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.361041 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.361357 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.361673 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.361992 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:24.530536 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf67271-f13c-4445-a418-2a7aeaebdf78 req-9f6b919e-9c6d-4f88-817e-0754d72d56d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:24.531321 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6d2b8b59-f9df-4964-bd3b-bf93621518ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:24.532177 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ccf67271-f13c-4445-a418-2a7aeaebdf78 req-9f6b919e-9c6d-4f88-817e-0754d72d56d8 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 1098 time: 0.0742152 Nov 12 14:59:24.547169 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716e9fed-709d-4fbb-ad73-8448d6967c34 req-e06247da-b67e-455d-98c4-78dc36a3d25f tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:24.548582 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-716e9fed-709d-4fbb-ad73-8448d6967c34 req-e06247da-b67e-455d-98c4-78dc36a3d25f tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 945 time: 0.0610032 Nov 12 14:59:24.615005 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ccf67271-f13c-4445-a418-2a7aeaebdf78 req-146ea7f4-6df2-449b-9283-10bb6826f868 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654478 Nov 12 14:59:24.618881 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-716e9fed-709d-4fbb-ad73-8448d6967c34 req-7c7f26e6-9235-4762-8a36-dcfe119a5a81 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637708 Nov 12 14:59:25.528800 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:25.736607 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215de28a-aeb5-4489-ba4c-db630244c27a req-dc8b6939-dd26-40ba-9385-325fcd3a3845 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:25.738082 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-215de28a-aeb5-4489-ba4c-db630244c27a req-dc8b6939-dd26-40ba-9385-325fcd3a3845 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 945 time: 0.0475519 Nov 12 14:59:25.786846 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-215de28a-aeb5-4489-ba4c-db630244c27a req-3eba8065-f150-46b3-9e39-38a9a3a1604d tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418105 Nov 12 14:59:26.905969 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d8bec6-3097-4f19-b9f2-f6de48dd6e2b req-1d20f32e-d33f-462f-b25e-22df188beb51 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:26.907504 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97d8bec6-3097-4f19-b9f2-f6de48dd6e2b req-1d20f32e-d33f-462f-b25e-22df188beb51 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 945 time: 0.0523272 Nov 12 14:59:26.925304 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:26.961422 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97d8bec6-3097-4f19-b9f2-f6de48dd6e2b req-6c9a9fe6-0b0a-4a16-8afe-a92eb6c00d6b tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470672 Nov 12 14:59:27.904884 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:28.041478 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59526) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:28.153403 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:28.224490 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:28.228761 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:28.265283 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=37ffbac437494519b6b58aa7f3a55fba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2227550 Nov 12 14:59:28.266123 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=593fdd2c-aa11-4398-8148-58a4ba98f6ec,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:28.268242 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59530) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:28.274359 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.274749 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.275091 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.275422 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.275751 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.276079 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.276427 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.276754 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.277078 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.277398 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.277718 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.278036 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af538a7-7d57-411b-b244-1c0c55e86ac6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:28.322621 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-16d0aaf9-7c42-4987-b643-1ebe64e5ac79 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:28.345494 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-16d0aaf9-7c42-4987-b643-1ebe64e5ac79 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:28.394549 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-16d0aaf9-7c42-4987-b643-1ebe64e5ac79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:28.397274 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-16d0aaf9-7c42-4987-b643-1ebe64e5ac79 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:28.398950 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-16d0aaf9-7c42-4987-b643-1ebe64e5ac79 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/593fdd2c-aa11-4398-8148-58a4ba98f6ec HTTP/1.1" status: 204 len: 168 time: 0.1296568 Nov 12 14:59:28.407903 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d0aaf9-7c42-4987-b643-1ebe64e5ac79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=593fdd2c-aa11-4398-8148-58a4ba98f6ec,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:34.948472 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:39.330885 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 14:59:39.364231 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59692) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:39.464597 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-00ac4510-f384-4d3b-a734-5e0baae9e020 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:39.535626 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-00ac4510-f384-4d3b-a734-5e0baae9e020 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:39.539419 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-00ac4510-f384-4d3b-a734-5e0baae9e020 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:39.576757 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-00ac4510-f384-4d3b-a734-5e0baae9e020 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=c9dcb448c6964fdf847b50b1fb6894ab&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2114902 Nov 12 14:59:39.577608 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ac4510-f384-4d3b-a734-5e0baae9e020 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6de7e805-e7cc-44d8-aa61-04da1fedf585,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:39.579410 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59696) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:39.627458 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-696b3242-5389-4101-855a-62565190d681 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:39.649372 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-696b3242-5389-4101-855a-62565190d681 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:39.695449 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-696b3242-5389-4101-855a-62565190d681 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:39.698125 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-696b3242-5389-4101-855a-62565190d681 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:39.699262 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-696b3242-5389-4101-855a-62565190d681 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/6de7e805-e7cc-44d8-aa61-04da1fedf585 HTTP/1.1" status: 204 len: 168 time: 0.1187642 Nov 12 14:59:39.707098 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696b3242-5389-4101-855a-62565190d681 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6de7e805-e7cc-44d8-aa61-04da1fedf585,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:39.961504 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59702) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:39.974470 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e606a699-08bd-4547-927b-5b90b2419af3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.056729 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e606a699-08bd-4547-927b-5b90b2419af3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.060811 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e606a699-08bd-4547-927b-5b90b2419af3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.098599 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e606a699-08bd-4547-927b-5b90b2419af3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7a07765-2cfb-45e9-92f8-6b0c288d6c00,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:40.103347 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-e606a699-08bd-4547-927b-5b90b2419af3 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=0b61e77310224f7b800b8ba82d8f2992&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1407692 Nov 12 14:59:40.105921 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59706) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:40.155874 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-784079ff-1db1-4867-a643-7464d05433b5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.176051 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-784079ff-1db1-4867-a643-7464d05433b5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.222554 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-784079ff-1db1-4867-a643-7464d05433b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.225336 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-784079ff-1db1-4867-a643-7464d05433b5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.226447 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-784079ff-1db1-4867-a643-7464d05433b5 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f7a07765-2cfb-45e9-92f8-6b0c288d6c00 HTTP/1.1" status: 204 len: 168 time: 0.1195886 Nov 12 14:59:40.234096 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-784079ff-1db1-4867-a643-7464d05433b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7a07765-2cfb-45e9-92f8-6b0c288d6c00,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:40.536371 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59712) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:40.550089 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b136edda-cb48-4925-b2c1-88e81c284a4a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.625042 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b136edda-cb48-4925-b2c1-88e81c284a4a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.629071 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b136edda-cb48-4925-b2c1-88e81c284a4a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.668714 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b136edda-cb48-4925-b2c1-88e81c284a4a admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=79908bd7eab54168b6405a24d348916c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1312537 Nov 12 14:59:40.669560 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b136edda-cb48-4925-b2c1-88e81c284a4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1c2facb-58f3-4756-ab69-efd170054582,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:40.671411 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59714) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:40.718664 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0fd8ffa1-27a3-44a6-8dd9-5100306a67af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.742871 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0fd8ffa1-27a3-44a6-8dd9-5100306a67af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.787046 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0fd8ffa1-27a3-44a6-8dd9-5100306a67af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.790141 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0fd8ffa1-27a3-44a6-8dd9-5100306a67af admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:40.791254 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-0fd8ffa1-27a3-44a6-8dd9-5100306a67af admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/b1c2facb-58f3-4756-ab69-efd170054582 HTTP/1.1" status: 204 len: 168 time: 0.1188824 Nov 12 14:59:40.799702 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd8ffa1-27a3-44a6-8dd9-5100306a67af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1c2facb-58f3-4756-ab69-efd170054582,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:47.946320 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31d0f9e3-c2f1-441e-9d94-83ea3e1e3e95 req-a65fab20-73df-4ff4-beff-90a9ec29a75f tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:47.947832 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-31d0f9e3-c2f1-441e-9d94-83ea3e1e3e95 req-a65fab20-73df-4ff4-beff-90a9ec29a75f tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 945 time: 0.0499971 Nov 12 14:59:47.994224 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-31d0f9e3-c2f1-441e-9d94-83ea3e1e3e95 req-c6c90b17-e60b-4a33-bd65-c8c6f5e498fb tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403953 Nov 12 14:59:48.689831 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59876) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:48.796560 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f5ab82c-747a-4d17-901a-c5ee25890547 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:48.869681 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f5ab82c-747a-4d17-901a-c5ee25890547 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:48.873776 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9f5ab82c-747a-4d17-901a-c5ee25890547 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:48.910145 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f5ab82c-747a-4d17-901a-c5ee25890547 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78dd3d51-8a5e-4405-bbdb-249729a2349f,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:48.914563 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-9f5ab82c-747a-4d17-901a-c5ee25890547 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=b5619c6dc35d45f1b3052cb9adfcfd79&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2235825 Nov 12 14:59:48.917282 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59880) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:48.964845 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-74185464-2fb9-4825-a31a-2dfac96e62f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:48.986409 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-74185464-2fb9-4825-a31a-2dfac96e62f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.036590 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-74185464-2fb9-4825-a31a-2dfac96e62f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.039343 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-74185464-2fb9-4825-a31a-2dfac96e62f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.043266 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-74185464-2fb9-4825-a31a-2dfac96e62f9 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/78dd3d51-8a5e-4405-bbdb-249729a2349f HTTP/1.1" status: 204 len: 168 time: 0.1250405 Nov 12 14:59:49.051289 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74185464-2fb9-4825-a31a-2dfac96e62f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78dd3d51-8a5e-4405-bbdb-249729a2349f,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:49.132605 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-295bea50-57b0-4752-a36d-35a9c5c0fd05 req-7127d3a3-c824-44dd-889a-00d8466513ab tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:49.134119 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-295bea50-57b0-4752-a36d-35a9c5c0fd05 req-7127d3a3-c824-44dd-889a-00d8466513ab tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 945 time: 0.0610867 Nov 12 14:59:49.182722 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-295bea50-57b0-4752-a36d-35a9c5c0fd05 req-cebfedab-f8cd-43e2-b286-dd6b74050ff9 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426183 Nov 12 14:59:49.305711 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59888) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:49.319263 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-44e28f3a-57b2-4276-9cab-a1c6a7c60b02 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.400266 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-44e28f3a-57b2-4276-9cab-a1c6a7c60b02 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.404820 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-44e28f3a-57b2-4276-9cab-a1c6a7c60b02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.445366 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-44e28f3a-57b2-4276-9cab-a1c6a7c60b02 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=bd2222a684a64155829d2f2f06f7a76d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1379125 Nov 12 14:59:49.446082 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e28f3a-57b2-4276-9cab-a1c6a7c60b02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84990c97-b624-4e52-ae9f-9c10aa0bfbde,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:49.448064 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59890) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:49.497988 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-47a08711-837d-4362-98c9-50381683cc4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.521251 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-47a08711-837d-4362-98c9-50381683cc4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.567192 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-47a08711-837d-4362-98c9-50381683cc4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.569805 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-47a08711-837d-4362-98c9-50381683cc4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.570945 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-47a08711-837d-4362-98c9-50381683cc4e admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/84990c97-b624-4e52-ae9f-9c10aa0bfbde HTTP/1.1" status: 204 len: 168 time: 0.1218596 Nov 12 14:59:49.579114 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47a08711-837d-4362-98c9-50381683cc4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84990c97-b624-4e52-ae9f-9c10aa0bfbde,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:49.894063 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59896) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:49.910178 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d4c5afde-2a76-4a7a-92e5-5cb49b08b44f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.991168 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d4c5afde-2a76-4a7a-92e5-5cb49b08b44f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:49.995085 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d4c5afde-2a76-4a7a-92e5-5cb49b08b44f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:50.035444 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d4c5afde-2a76-4a7a-92e5-5cb49b08b44f admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d6cd613088ab41068a176f34d6c75ee1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1401162 Nov 12 14:59:50.036401 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4c5afde-2a76-4a7a-92e5-5cb49b08b44f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ebb57126-a2a2-46bd-b2ce-1b3a8fec2e99,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:50.037957 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59898) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:50.086816 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2d0655f6-32a9-487b-b987-d9fea8b96823 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:50.111352 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2d0655f6-32a9-487b-b987-d9fea8b96823 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:50.157442 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2d0655f6-32a9-487b-b987-d9fea8b96823 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:50.160034 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2d0655f6-32a9-487b-b987-d9fea8b96823 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:50.161232 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-2d0655f6-32a9-487b-b987-d9fea8b96823 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/ebb57126-a2a2-46bd-b2ce-1b3a8fec2e99 HTTP/1.1" status: 204 len: 168 time: 0.1223066 Nov 12 14:59:50.169531 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d0655f6-32a9-487b-b987-d9fea8b96823 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebb57126-a2a2-46bd-b2ce-1b3a8fec2e99,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:50.306574 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3085969f-810d-4ab4-8f29-0b7d3ea9f611 req-06e8f1c5-b632-443e-a8d6-980126cce1a9 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:50.312592 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3085969f-810d-4ab4-8f29-0b7d3ea9f611 req-06e8f1c5-b632-443e-a8d6-980126cce1a9 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 945 time: 0.0615058 Nov 12 14:59:50.403629 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-7b3fc3d1-4940-487c-a49f-4b8287bdb958 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:50.405100 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-7b3fc3d1-4940-487c-a49f-4b8287bdb958 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.86 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 945 time: 0.0912850 Nov 12 14:59:50.408858 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3085969f-810d-4ab4-8f29-0b7d3ea9f611 req-4fca7a0c-e961-4242-8fd9-d15dd985715d tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/security-groups?id=74f530ff-ef50-475b-b409-b28efb99f0d0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0937328 Nov 12 14:59:50.503475 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Deleting port e866cc64-ce6b-4022-97ab-01c1add377e0 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 14:59:50.504078 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:50.606821 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] For port e866cc64-ce6b-4022-97ab-01c1add377e0, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=e866cc64-ce6b-4022-97ab-01c1add377e0,segment=NetworkSegment(8d885094-f225-46f0-a8f7-af9d90c9da56),segment_id=8d885094-f225-46f0-a8f7-af9d90c9da56)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:50.607204 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:50.621265 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Calling delete_port for e866cc64-ce6b-4022-97ab-01c1add377e0 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 14:59:50.755249 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:50.778030 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['e866cc64-ce6b-4022-97ab-01c1add377e0'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 14:59:50.788688 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Pushing event deleted for resources: {'Port': ['ID=e866cc64-ce6b-4022-97ab-01c1add377e0,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:50.827883 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] No DVR routers for this DVR port e866cc64-ce6b-4022-97ab-01c1add377e0 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 14:59:50.830373 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:50.833660 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18c5ab51-5296-42ff-a6bb-6f2efa76ee47 req-fb64c0c6-5384-4ca7-a911-3e7fa84f8a34 tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.86 "DELETE /v2.0/ports/e866cc64-ce6b-4022-97ab-01c1add377e0 HTTP/1.1" status: 204 len: 173 time: 0.4177222 Nov 12 14:59:50.834089 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9f2c3bf-5399-4a09-91e7-f35ca8c02eec', 'name': 'network-vif-deleted', 'tag': 'e866cc64-ce6b-4022-97ab-01c1add377e0'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 14:59:50.836361 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee2c9ca3-7e6a-4b8c-9d99-a381b6cd89ef" -d '{"events": [{"server_uuid": "f9f2c3bf-5399-4a09-91e7-f35ca8c02eec", "name": "network-vif-deleted", "tag": "e866cc64-ce6b-4022-97ab-01c1add377e0"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 14:59:50.875743 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 14:59:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bc7e1ce-cf84-4132-8628-a476e55b16aa x-openstack-request-id: req-4bc7e1ce-cf84-4132-8628-a476e55b16aa {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 14:59:50.876162 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9f2c3bf-5399-4a09-91e7-f35ca8c02eec", "name": "network-vif-deleted", "tag": "e866cc64-ce6b-4022-97ab-01c1add377e0", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 14:59:50.876470 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-4bc7e1ce-cf84-4132-8628-a476e55b16aa {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 14:59:50.876588 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59926) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:50.876940 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9f2c3bf-5399-4a09-91e7-f35ca8c02eec', 'name': 'network-vif-deleted', 'tag': 'e866cc64-ce6b-4022-97ab-01c1add377e0', 'status': 'completed', 'code': 200} Nov 12 14:59:50.977544 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-351754592-network', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:59:51.000270 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Made reservation on behalf of 081b60b81cf04cd28b26a5b5cf5d5888 for: {'network': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:59:51.002586 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.011688 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.092097 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.096131 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.122965 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 614} {{(pid=101617) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:59:51.134101 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=407a8ee7-48fd-4e47-a4e0-23203c0a793d,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:51.140918 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.141335 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.segments_db [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Added segment 7219405f-f48a-498b-8c75-af2c335a831e of type vlan for network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 Nov 12 14:59:51.183359 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.208357 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.209414 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:51.210008 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.267598 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3880687 Nov 12 14:59:51.270586 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59932) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:51.275497 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba242171-12cf-4f42-8e6a-c8219e8e26e3 admin admin] Pushing event updated for resources: {'Network': ['ID=fb9a4b4b-b9a5-4585-a360-1f294aeb3903,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:51.275737 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Request body: {'subnet': {'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-351754592-subnet', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'ip_version': 4}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:59:51.285980 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:59:51.297651 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Made reservation on behalf of 081b60b81cf04cd28b26a5b5cf5d5888 for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:59:51.300675 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5528411'] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.485969 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5822845', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5528393'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.560844 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0da6866d-6087-4991-b844-db80c56b441c req-3d403e19-67ed-480c-b7b6-3fe6c074a26d tempest-VolumesSnapshotTestJSON-1645313205 tempest-VolumesSnapshotTestJSON-1645313205-project] 10.222.0.61 "GET /v2.0/ports?device_id=f9f2c3bf-5399-4a09-91e7-f35ca8c02eec HTTP/1.1" status: 200 len: 210 time: 0.0436745 Nov 12 14:59:51.584098 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Pushing event updated for resources: {'Subnet': ['ID=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:51.592012 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Checking segment: {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:59:51.592415 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Network hostable DHCP agents. Network: fb9a4b4b-b9a5-4585-a360-1f294aeb3903, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:59:51.612637 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:59:51.621423 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, fb9a4b4b-b9a5-4585-a360-1f294aeb3903) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:51.626076 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:51.626813 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.631336 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15942c39-4189-4c9c-ba07-389c5b6119bc None None] Network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:59:51.644474 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-fb4951f4-098a-4cd5-9be5-62ba8c5738dd admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3727529 Nov 12 14:59:51.648211 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59936) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:51.652580 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:59:51.674164 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.675426 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.733783 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.808320 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 14:59:51.809950 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.889245 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:51.955131 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Allocated IP 172.20.0.2 (fb9a4b4b-b9a5-4585-a360-1f294aeb3903/f4fb6dc5-7523-48a4-a992-01a08cf2fcf4/8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:59:52.095176 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.107438 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-003ec252-00ab-4b47-b3bc-871f6af844bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.111836 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.118289 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.119372 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.158539 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:59:52.161214 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:52.167272 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:59:52.179681 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Pushing event updated for resources: {'Port': ['ID=8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:52.225572 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Allocated IP 172.27.3.200 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/b3007359-aa15-4e33-84a7-316b751dbbae) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:59:52.225927 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Attempting to bind port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:59:52.226274 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Attempting to bind port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:59:52.226634 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Attempting to bind port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e on network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:59:52.232034 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 59, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:59:52.232436 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Checking segment: {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:59:52.232868 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.233214 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Bound using segment: {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:59:52.233774 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Bound port: 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:59:52.234050 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.295750 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] For port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:59:52.299191 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] For port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:59:52.302943 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.333925 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.363350 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8b9d55-6bc8-4f96-bdb2-190172491569 None None] Pushing event updated for resources: {'Port': ['ID=8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:52.379795 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.419274 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:59:52.426372 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:52.429308 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:59:52.454105 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Pushing event updated for resources: {'Port': ['ID=b3007359-aa15-4e33-84a7-316b751dbbae,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:52.710500 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.818924 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:59:52.874465 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:52.874923 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.966348 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:52.968140 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:53.008275 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:53.013641 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:53.067363 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:53.149491 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Router bd049b89-6c39-46a2-a0d7-61445958d280 is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101618) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 14:59:53.260714 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:59:53.270522 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Sync routers for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:59:53.278409 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-490c64fb-6bf3-415a-9792-5a4a05b945e8 None None] Network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:59:53.279661 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:53.283272 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-611d8d2d-df88-4d84-a63b-8147f4a3f96e admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.6316273 Nov 12 14:59:53.283580 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59948) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:53.428765 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:59:53.429928 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:53.526419 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-2f995d06-34e8-464b-8301-7f29baa0512c None None] Provisioning complete for port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:53.526677 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2f995d06-34e8-464b-8301-7f29baa0512c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:53.651551 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:59:53.904604 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:52Z', 'revision_number': 3, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:53.932273 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Checking router: bd049b89-6c39-46a2-a0d7-61445958d280 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:59:53.933852 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Updating router bd049b89-6c39-46a2-a0d7-61445958d280 port b3007359-aa15-4e33-84a7-316b751dbbae binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:59:53.957801 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:53.960505 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.082306 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-da494751-d7a6-4fa8-9093-e6546acdb864 None None] Provisioning complete for port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:54.082757 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-da494751-d7a6-4fa8-9093-e6546acdb864 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.166770 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Allocated IP 172.20.0.1 (fb9a4b4b-b9a5-4585-a360-1f294aeb3903/f4fb6dc5-7523-48a4-a992-01a08cf2fcf4/74454b28-10e6-472e-9310-ea7a4e5be254) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:59:54.280284 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.297857 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device e866cc64-ce6b-4022-97ab-01c1add377e0 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 14:59:54.305134 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.315239 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.327735 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: e866cc64-ce6b-4022-97ab-01c1add377e0 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 14:59:54.328099 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device e866cc64-ce6b-4022-97ab-01c1add377e0 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 14:59:54.330975 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.354841 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:59:54.361668 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:54.366904 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:59:54.370125 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Pushing event updated for resources: {'Port': ['ID=74454b28-10e6-472e-9310-ea7a4e5be254,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:54.384619 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Attempting to bind port b3007359-aa15-4e33-84a7-316b751dbbae on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:59:54.384619 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Attempting to bind port b3007359-aa15-4e33-84a7-316b751dbbae by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:59:54.384922 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Attempting to bind port b3007359-aa15-4e33-84a7-316b751dbbae on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:59:54.403167 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801d924d-b2b7-43ac-bf65-3bb41429b47d None None] Pushing event updated for resources: {'Port': ['ID=b3007359-aa15-4e33-84a7-316b751dbbae,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:54.406540 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 59, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:59:54.406923 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:59:54.407255 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.407645 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:59:54.408579 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Bound port: b3007359-aa15-4e33-84a7-316b751dbbae, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:59:54.408579 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.414787 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.468728 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] For port b3007359-aa15-4e33-84a7-316b751dbbae, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:59:54.476907 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] For port b3007359-aa15-4e33-84a7-316b751dbbae, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=b3007359-aa15-4e33-84a7-316b751dbbae,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:59:54.481605 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.567118 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:59:54.567751 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:54.572033 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-47061cb5-1d14-4696-a72e-f7af7f36c4c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.575982 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801d924d-b2b7-43ac-bf65-3bb41429b47d None None] Pushing event updated for resources: {'Port': ['ID=b3007359-aa15-4e33-84a7-316b751dbbae,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:54.583079 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.695282 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-cf1caeb9-0e6d-4422-8fe9-69f7a5da1d76 None None] Provisioning complete for port 74454b28-10e6-472e-9310-ea7a4e5be254 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:54.695642 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-cf1caeb9-0e6d-4422-8fe9-69f7a5da1d76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.698350 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:59:54.759849 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.768187 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.771433 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-cf1caeb9-0e6d-4422-8fe9-69f7a5da1d76 None None] Port 74454b28-10e6-472e-9310-ea7a4e5be254 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:59:54.803313 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:59:54.845310 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.848069 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Pushing event updated for resources: {'Port': ['ID=74454b28-10e6-472e-9310-ea7a4e5be254,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:54.922439 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:54.923018 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:54.942195 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:59:54.943811 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:55.075147 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Router bd049b89-6c39-46a2-a0d7-61445958d280 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 14:59:55.173161 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 1, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:55.199210 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:59:55.204947 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b4bc8df4-525e-4553-8791-fdd5837311d5 admin admin] 10.222.0.61 "PUT /v2.0/routers/bd049b89-6c39-46a2-a0d7-61445958d280/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9202547 Nov 12 14:59:55.210273 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-502103ce-2cd9-413e-b8eb-26fd6ea010bb None None] The sync data for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi is: [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 1, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:59:55.226442 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-620e4a74-ebe7-498f-b62b-7e795251ccf5 None None] Provisioning complete for port 74454b28-10e6-472e-9310-ea7a4e5be254 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:55.226813 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-620e4a74-ebe7-498f-b62b-7e795251ccf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:55.269453 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-620e4a74-ebe7-498f-b62b-7e795251ccf5 None None] Port 74454b28-10e6-472e-9310-ea7a4e5be254 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 14:59:55.541616 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:55.752138 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59972) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:55.757062 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1694409861-network', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:59:55.798363 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Made reservation on behalf of 697591285a6e44daa3000fca1ccf7e4a for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:59:55.801446 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:55.811823 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:55.926060 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:55.931145 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:55.962504 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 605} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 14:59:55.973798 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd8fce51-8d51-4868-aaa9-fab4a7261554,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:55.979680 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:55.979933 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Added segment 9264d629-34c9-4a63-8c7e-91fb364a4875 of type vlan for network 36029b5a-89ee-422a-a728-17855197aded Nov 12 14:59:56.028128 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.061995 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.063006 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:56.063593 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.130609 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3745162 Nov 12 14:59:56.131253 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59974) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:56.135882 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Request body: {'subnet': {'network_id': '36029b5a-89ee-422a-a728-17855197aded', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1694409861-subnet', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'ip_version': 4}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:59:56.147811 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59130b4f-d72a-4756-a771-ed653238dcb5 admin admin] Pushing event updated for resources: {'Network': ['ID=36029b5a-89ee-422a-a728-17855197aded,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:56.158446 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 36029b5a-89ee-422a-a728-17855197aded details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 14:59:56.173251 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Made reservation on behalf of 697591285a6e44daa3000fca1ccf7e4a for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 14:59:56.175667 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5528411'] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.382725 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5822845', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5528393'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.440367 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Pushing event updated for resources: {'Subnet': ['ID=39333609-040c-402e-935a-d3f3817a37b2,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:56.451540 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Checking segment: {'id': '9264d629-34c9-4a63-8c7e-91fb364a4875', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '36029b5a-89ee-422a-a728-17855197aded'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:59:56.451958 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Network hostable DHCP agents. Network: 36029b5a-89ee-422a-a728-17855197aded, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 14:59:56.471577 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Network 36029b5a-89ee-422a-a728-17855197aded is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 14:59:56.480802 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 36029b5a-89ee-422a-a728-17855197aded) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:56.485180 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 14:59:56.485771 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.490629 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7f80521-1338-46ab-8d8c-a662118ace73 None None] Network 36029b5a-89ee-422a-a728-17855197aded requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:59:56.505395 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d2556482-227e-4ee5-9b1e-49774a8f2108 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3710678 Nov 12 14:59:56.505630 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 59978) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:56.511454 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 14:59:56.534845 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.535891 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.594544 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.657420 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-36029b5a-89ee-422a-a728-17855197aded', 'network_id': '36029b5a-89ee-422a-a728-17855197aded', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'fixed_ips': [{'subnet_id': '39333609-040c-402e-935a-d3f3817a37b2'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 14:59:56.658292 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.739191 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.811030 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Allocated IP 172.20.0.2 (36029b5a-89ee-422a-a728-17855197aded/39333609-040c-402e-935a-d3f3817a37b2/319eddac-ea17-4267-82f4-b437b8ffbb93) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:59:56.828902 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device b3007359-aa15-4e33-84a7-316b751dbbae up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:59:56.952639 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.954696 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.959705 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port b3007359-aa15-4e33-84a7-316b751dbbae triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:56.960068 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:56.973851 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.049331 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.055824 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.090270 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Allocated IP 172.27.3.158 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/275878ff-09ad-463b-b346-da1cd1f8b9ad) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:59:57.123877 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Network 36029b5a-89ee-422a-a728-17855197aded is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:59:57.131818 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:57.137776 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:59:57.141137 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Pushing event updated for resources: {'Port': ['ID=319eddac-ea17-4267-82f4-b437b8ffbb93,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:57.145246 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.183429 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port b3007359-aa15-4e33-84a7-316b751dbbae, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=b3007359-aa15-4e33-84a7-316b751dbbae,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:57.199308 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.201257 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.214104 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Attempting to bind port 319eddac-ea17-4267-82f4-b437b8ffbb93 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:59:57.214471 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Attempting to bind port 319eddac-ea17-4267-82f4-b437b8ffbb93 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '9264d629-34c9-4a63-8c7e-91fb364a4875', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '36029b5a-89ee-422a-a728-17855197aded'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:59:57.214825 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Attempting to bind port 319eddac-ea17-4267-82f4-b437b8ffbb93 on network 36029b5a-89ee-422a-a728-17855197aded {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:59:57.244043 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.245892 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 59, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:59:57.246255 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Checking segment: {'id': '9264d629-34c9-4a63-8c7e-91fb364a4875', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '36029b5a-89ee-422a-a728-17855197aded'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:59:57.246841 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.247388 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Bound using segment: {'id': '9264d629-34c9-4a63-8c7e-91fb364a4875', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '36029b5a-89ee-422a-a728-17855197aded'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:59:57.247869 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Bound port: 319eddac-ea17-4267-82f4-b437b8ffbb93, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9264d629-34c9-4a63-8c7e-91fb364a4875', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '36029b5a-89ee-422a-a728-17855197aded'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:59:57.248410 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.285428 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:59:57.293366 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:57.297546 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:59:57.301646 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=b3007359-aa15-4e33-84a7-316b751dbbae,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:57.328584 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Pushing event updated for resources: {'Port': ['ID=275878ff-09ad-463b-b346-da1cd1f8b9ad,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:57.330384 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] For port 319eddac-ea17-4267-82f4-b437b8ffbb93, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:59:57.335364 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] For port 319eddac-ea17-4267-82f4-b437b8ffbb93, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=319eddac-ea17-4267-82f4-b437b8ffbb93,segment=NetworkSegment(9264d629-34c9-4a63-8c7e-91fb364a4875),segment_id=9264d629-34c9-4a63-8c7e-91fb364a4875)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:59:57.341244 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.404799 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b515b8b-07ae-4c76-993d-ef776d05e8cd None None] Pushing event updated for resources: {'Port': ['ID=319eddac-ea17-4267-82f4-b437b8ffbb93,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:57.475994 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Sync routers for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:59:57.487522 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:59:57.488152 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:57.583792 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.617785 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:59:57.878473 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 2, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:57.911352 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Checking router: bd049b89-6c39-46a2-a0d7-61445958d280 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:59:57.911898 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Updating router bd049b89-6c39-46a2-a0d7-61445958d280 port 74454b28-10e6-472e-9310-ea7a4e5be254 binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:59:57.914756 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:57.938962 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:58.113238 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:58.221562 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:58.228843 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:58.262400 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Router 1b7beec1-89da-42c3-9717-c12a2e772716 is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101618) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 14:59:58.286440 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Pushing event updated for resources: {'Port': ['ID=74454b28-10e6-472e-9310-ea7a4e5be254,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:58.295331 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.295695 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.296040 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.296402 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.296910 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.297395 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.297879 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.298381 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.298991 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.300251 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.300756 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.301236 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 14:59:58.368582 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Attempting to bind port 74454b28-10e6-472e-9310-ea7a4e5be254 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 14:59:58.368822 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Attempting to bind port 74454b28-10e6-472e-9310-ea7a4e5be254 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 14:59:58.369295 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Attempting to bind port 74454b28-10e6-472e-9310-ea7a4e5be254 on network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 14:59:58.377294 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 14:59:58.378025 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Checking segment: {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 14:59:58.379184 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:58.379581 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Bound using segment: {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 14:59:58.380072 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Bound port: 74454b28-10e6-472e-9310-ea7a4e5be254, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 14:59:58.380509 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:58.390097 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 14:59:58.399595 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Sync routers for ids ['1b7beec1-89da-42c3-9717-c12a2e772716'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 14:59:58.414937 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:58.416316 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-78ab78ba-189a-40aa-be5f-34bff0cb9753 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 1.9094400 Nov 12 14:59:58.419339 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 59988) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 14:59:58.420466 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Routers {'1b7beec1-89da-42c3-9717-c12a2e772716'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:59:58.421135 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['1b7beec1-89da-42c3-9717-c12a2e772716'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:58.479523 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] For port 74454b28-10e6-472e-9310-ea7a4e5be254, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 14:59:58.484404 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] For port 74454b28-10e6-472e-9310-ea7a4e5be254, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=74454b28-10e6-472e-9310-ea7a4e5be254,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 14:59:58.497671 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:58.551820 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Set router 1b7beec1-89da-42c3-9717-c12a2e772716 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:59:58.581873 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-104b00a7-5efb-4c83-9dcd-b75b2c8b6dfc None None] Pushing event updated for resources: {'Port': ['ID=74454b28-10e6-472e-9310-ea7a4e5be254,revision_number=4']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:58.623266 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 14:59:58.624192 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:58.755399 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-4a1683e8-ab88-4d57-aad6-49a72521484a None None] Provisioning complete for port 74454b28-10e6-472e-9310-ea7a4e5be254 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:58.756019 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4a1683e8-ab88-4d57-aad6-49a72521484a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:58.858062 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48e6124f-15c8-4adf-89f2-fb4f7b388658 None None] Network 36029b5a-89ee-422a-a728-17855197aded requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 14:59:58.863890 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 14:59:59.034821 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device b3007359-aa15-4e33-84a7-316b751dbbae up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:59:59.169705 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4a1683e8-ab88-4d57-aad6-49a72521484a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:59.186516 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 3, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'gw_port': {'id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:93:be', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:59.229729 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Checking router: 1b7beec1-89da-42c3-9717-c12a2e772716 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 14:59:59.230344 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Updating router 1b7beec1-89da-42c3-9717-c12a2e772716 port 275878ff-09ad-463b-b346-da1cd1f8b9ad binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 14:59:59.277467 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:58Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 14:59:59.298558 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-4a1683e8-ab88-4d57-aad6-49a72521484a None None] For port 74454b28-10e6-472e-9310-ea7a4e5be254, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=74454b28-10e6-472e-9310-ea7a4e5be254,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 14:59:59.307719 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port b3007359-aa15-4e33-84a7-316b751dbbae triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:59.308374 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:59.312692 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4a1683e8-ab88-4d57-aad6-49a72521484a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:59.313800 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9662c4ca-3607-45d4-941f-1082f63e2af7 None None] The sync data for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi is: [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:58Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 14:59:59.333943 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:59.346615 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:59.501786 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1683e8-ab88-4d57-aad6-49a72521484a None None] Pushing event updated for resources: {'Port': ['ID=74454b28-10e6-472e-9310-ea7a4e5be254,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 14:59:59.527834 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Allocated IP 172.20.0.1 (36029b5a-89ee-422a-a728-17855197aded/39333609-040c-402e-935a-d3f3817a37b2/8f9fcefe-e0b6-4098-b5b7-db33570e1fd2) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 14:59:59.665707 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:59.705369 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:59.712456 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-0fa3d1ca-6527-44d8-b7ec-42959f5aebf4 None None] Provisioning complete for port 319eddac-ea17-4267-82f4-b437b8ffbb93 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 14:59:59.712834 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0fa3d1ca-6527-44d8-b7ec-42959f5aebf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 14:59:59.748066 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Network 36029b5a-89ee-422a-a728-17855197aded is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 14:59:59.755996 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 14:59:59.762555 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 14:59:59.847710 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 319eddac-ea17-4267-82f4-b437b8ffbb93 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 14:59:59.851605 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.024825 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Pushing event updated for resources: {'Port': ['ID=8f9fcefe-e0b6-4098-b5b7-db33570e1fd2,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:00.061347 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.076997 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.195704 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.202712 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0fa3d1ca-6527-44d8-b7ec-42959f5aebf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.293026 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-0fa3d1ca-6527-44d8-b7ec-42959f5aebf4 None None] For port 319eddac-ea17-4267-82f4-b437b8ffbb93, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=319eddac-ea17-4267-82f4-b437b8ffbb93,segment=NetworkSegment(9264d629-34c9-4a63-8c7e-91fb364a4875),segment_id=9264d629-34c9-4a63-8c7e-91fb364a4875)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:00.295605 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ad95d98-e8f8-4ce1-9963-67bc5596e841 None None] Pushing event updated for resources: {'Port': ['ID=275878ff-09ad-463b-b346-da1cd1f8b9ad,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:00.314544 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 319eddac-ea17-4267-82f4-b437b8ffbb93 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:00.315383 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.327332 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0fa3d1ca-6527-44d8-b7ec-42959f5aebf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.389535 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Attempting to bind port 275878ff-09ad-463b-b346-da1cd1f8b9ad on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:00.390105 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Attempting to bind port 275878ff-09ad-463b-b346-da1cd1f8b9ad by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:00.390509 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Attempting to bind port 275878ff-09ad-463b-b346-da1cd1f8b9ad on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:00.398194 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.405983 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7428717'] for port, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.415780 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:00.416329 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:00.416596 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.416991 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:00.417476 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Bound port: 275878ff-09ad-463b-b346-da1cd1f8b9ad, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:00.417855 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.461857 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.478772 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-0fa3d1ca-6527-44d8-b7ec-42959f5aebf4 None None] Provisioning complete for port 74454b28-10e6-472e-9310-ea7a4e5be254 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:00.479201 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0fa3d1ca-6527-44d8-b7ec-42959f5aebf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.560193 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa3d1ca-6527-44d8-b7ec-42959f5aebf4 None None] Pushing event updated for resources: {'Port': ['ID=319eddac-ea17-4267-82f4-b437b8ffbb93,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:00.596709 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] For port 275878ff-09ad-463b-b346-da1cd1f8b9ad, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:00.611243 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Pushing event updated for resources: {'Port': ['ID=8f9fcefe-e0b6-4098-b5b7-db33570e1fd2,revision_number=2']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:00.633751 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] For port 275878ff-09ad-463b-b346-da1cd1f8b9ad, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=275878ff-09ad-463b-b346-da1cd1f8b9ad,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:00.659705 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:00.666429 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Network 36029b5a-89ee-422a-a728-17855197aded is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:00.668230 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:00.749807 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ad95d98-e8f8-4ce1-9963-67bc5596e841 None None] Pushing event updated for resources: {'Port': ['ID=275878ff-09ad-463b-b346-da1cd1f8b9ad,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:00.751974 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Routers {'1b7beec1-89da-42c3-9717-c12a2e772716'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:00.752939 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['1b7beec1-89da-42c3-9717-c12a2e772716'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:00.828652 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Router 1b7beec1-89da-42c3-9717-c12a2e772716 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:00:00.878433 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0eea55-5575-4163-aacf-41f6802d4551 req-1db4d941-2e79-40b5-8648-14a9f1e9a368 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:00.893082 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5c0eea55-5575-4163-aacf-41f6802d4551 req-1db4d941-2e79-40b5-8648-14a9f1e9a368 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.4542544 Nov 12 15:00:00.942710 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 74454b28-10e6-472e-9310-ea7a4e5be254 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:00.982037 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5c0eea55-5575-4163-aacf-41f6802d4551 req-f265104e-2619-4338-b9a1-dfdd1839526d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0866103 Nov 12 15:00:01.001656 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] Set router 1b7beec1-89da-42c3-9717-c12a2e772716 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:01.015960 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:01.021526 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-21d34015-db32-4c4e-bf29-78dab01cd869 admin admin] 10.222.0.61 "PUT /v2.0/routers/1b7beec1-89da-42c3-9717-c12a2e772716/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6002486 Nov 12 15:00:01.032141 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-12c54de5-aa19-4403-b1d9-c263f818eb07 None None] Provisioning complete for port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:01.033371 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-12c54de5-aa19-4403-b1d9-c263f818eb07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:01.131358 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-12c54de5-aa19-4403-b1d9-c263f818eb07 None None] Port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:01.158781 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 74454b28-10e6-472e-9310-ea7a4e5be254 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:01.159148 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:01.217677 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-12c54de5-aa19-4403-b1d9-c263f818eb07 None None] Provisioning complete for port 319eddac-ea17-4267-82f4-b437b8ffbb93 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:01.218045 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-12c54de5-aa19-4403-b1d9-c263f818eb07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:01.393129 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 319eddac-ea17-4267-82f4-b437b8ffbb93 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:01.445293 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 4, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'gw_port': {'id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:93:be', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T15:00:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '8f9fcefe-e0b6-4098-b5b7-db33570e1fd2', 'name': '', 'network_id': '36029b5a-89ee-422a-a728-17855197aded', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'mac_address': 'fa:16:3e:64:5e:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '39333609-040c-402e-935a-d3f3817a37b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:59Z', 'updated_at': '2021-11-12T15:00:00Z', 'revision_number': 2, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'subnets': [{'id': '39333609-040c-402e-935a-d3f3817a37b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:01.478845 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73018553-6931-4afe-be59-242c803b3eb0 None None] The sync data for ids ['1b7beec1-89da-42c3-9717-c12a2e772716'] in dv-cinder-776422-5-iscsi is: [{'id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 4, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'gw_port': {'id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:93:be', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T15:00:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '8f9fcefe-e0b6-4098-b5b7-db33570e1fd2', 'name': '', 'network_id': '36029b5a-89ee-422a-a728-17855197aded', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'mac_address': 'fa:16:3e:64:5e:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '39333609-040c-402e-935a-d3f3817a37b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:59Z', 'updated_at': '2021-11-12T15:00:00Z', 'revision_number': 2, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'subnets': [{'id': '39333609-040c-402e-935a-d3f3817a37b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:01.490565 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 319eddac-ea17-4267-82f4-b437b8ffbb93 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:01.490942 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:01.596509 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-8d460f9b-cf4a-4c14-91b2-c040b949308d None None] Provisioning complete for port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:01.597173 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8d460f9b-cf4a-4c14-91b2-c040b949308d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:01.653269 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-8d460f9b-cf4a-4c14-91b2-c040b949308d None None] Port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:02.326382 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c63ffdfc-495d-4789-968e-18f1ba96532f req-70f7223d-7dfd-4f59-ba17-e830220e9a81 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:02.328068 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c63ffdfc-495d-4789-968e-18f1ba96532f req-70f7223d-7dfd-4f59-ba17-e830220e9a81 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1803300 Nov 12 15:00:02.402348 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c63ffdfc-495d-4789-968e-18f1ba96532f req-2a7648a2-fa08-4781-8a70-81d032f3f898 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0626566 Nov 12 15:00:02.866778 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 275878ff-09ad-463b-b346-da1cd1f8b9ad up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:02.949827 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 275878ff-09ad-463b-b346-da1cd1f8b9ad triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:02.950193 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:03.042620 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:03.085558 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port 275878ff-09ad-463b-b346-da1cd1f8b9ad, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=275878ff-09ad-463b-b346-da1cd1f8b9ad,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:03.092849 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:03.303446 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=275878ff-09ad-463b-b346-da1cd1f8b9ad,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:03.540075 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df9628b-f607-4ba0-b678-ca961fa52e2f req-0e6f55b5-4146-4425-a40e-aa73720486b8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:03.550483 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0df9628b-f607-4ba0-b678-ca961fa52e2f req-0e6f55b5-4146-4425-a40e-aa73720486b8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0705361 Nov 12 15:00:03.608166 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0df9628b-f607-4ba0-b678-ca961fa52e2f req-14cd8339-ba77-417d-a435-ee736916c2b8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563533 Nov 12 15:00:03.940633 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Sync routers for ids ['1b7beec1-89da-42c3-9717-c12a2e772716'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:03.952033 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Routers {'1b7beec1-89da-42c3-9717-c12a2e772716'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:03.952720 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['1b7beec1-89da-42c3-9717-c12a2e772716'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:04.076418 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Set router 1b7beec1-89da-42c3-9717-c12a2e772716 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:04.328508 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 4, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'gw_port': {'id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:93:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T15:00:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '8f9fcefe-e0b6-4098-b5b7-db33570e1fd2', 'name': '', 'network_id': '36029b5a-89ee-422a-a728-17855197aded', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'mac_address': 'fa:16:3e:64:5e:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '39333609-040c-402e-935a-d3f3817a37b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:59Z', 'updated_at': '2021-11-12T15:00:00Z', 'revision_number': 2, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'subnets': [{'id': '39333609-040c-402e-935a-d3f3817a37b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:04.355412 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Checking router: 1b7beec1-89da-42c3-9717-c12a2e772716 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:04.355755 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Updating router 1b7beec1-89da-42c3-9717-c12a2e772716 port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 15:00:04.381802 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:04.713183 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:04.747783 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:04.797742 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28a93610-2f03-40f1-9f65-f955a3660422 req-c4b9d60e-59cf-4dae-9f6a-d744356b6b89 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:04.801193 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-28a93610-2f03-40f1-9f65-f955a3660422 req-c4b9d60e-59cf-4dae-9f6a-d744356b6b89 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.1027048 Nov 12 15:00:04.822880 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ad3b4c2-d30a-416c-96e6-31a1ac791f08 None None] Pushing event updated for resources: {'Port': ['ID=8f9fcefe-e0b6-4098-b5b7-db33570e1fd2,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:04.882638 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-28a93610-2f03-40f1-9f65-f955a3660422 req-5a879bc9-e67d-4bf5-bcb1-7531dac5fa62 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754557 Nov 12 15:00:04.893563 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 275878ff-09ad-463b-b346-da1cd1f8b9ad up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:04.914349 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Attempting to bind port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:04.915020 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Attempting to bind port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '9264d629-34c9-4a63-8c7e-91fb364a4875', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '36029b5a-89ee-422a-a728-17855197aded'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:04.915550 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Attempting to bind port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 on network 36029b5a-89ee-422a-a728-17855197aded {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:04.926669 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:04.927374 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Checking segment: {'id': '9264d629-34c9-4a63-8c7e-91fb364a4875', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '36029b5a-89ee-422a-a728-17855197aded'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:04.928503 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:04.929655 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Bound using segment: {'id': '9264d629-34c9-4a63-8c7e-91fb364a4875', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '36029b5a-89ee-422a-a728-17855197aded'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:04.930332 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Bound port: 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9264d629-34c9-4a63-8c7e-91fb364a4875', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '36029b5a-89ee-422a-a728-17855197aded'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:04.930920 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:04.972909 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:04.992027 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 275878ff-09ad-463b-b346-da1cd1f8b9ad triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:04.993122 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:05.010317 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] For port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:05.014223 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] For port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=8f9fcefe-e0b6-4098-b5b7-db33570e1fd2,segment=NetworkSegment(9264d629-34c9-4a63-8c7e-91fb364a4875),segment_id=9264d629-34c9-4a63-8c7e-91fb364a4875)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:05.019832 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:05.094351 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ad3b4c2-d30a-416c-96e6-31a1ac791f08 None None] Pushing event updated for resources: {'Port': ['ID=8f9fcefe-e0b6-4098-b5b7-db33570e1fd2,revision_number=4']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:05.115924 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Routers {'1b7beec1-89da-42c3-9717-c12a2e772716'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:05.116591 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['1b7beec1-89da-42c3-9717-c12a2e772716'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:05.141029 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-59f306f5-8d5a-4e3c-b58c-0f267131f158 None None] Provisioning complete for port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:05.141487 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-59f306f5-8d5a-4e3c-b58c-0f267131f158 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:05.255411 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] Set router 1b7beec1-89da-42c3-9717-c12a2e772716 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:05.277140 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-59f306f5-8d5a-4e3c-b58c-0f267131f158 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:05.352512 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-59f306f5-8d5a-4e3c-b58c-0f267131f158 None None] For port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=8f9fcefe-e0b6-4098-b5b7-db33570e1fd2,segment=NetworkSegment(9264d629-34c9-4a63-8c7e-91fb364a4875),segment_id=9264d629-34c9-4a63-8c7e-91fb364a4875)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:05.360170 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-59f306f5-8d5a-4e3c-b58c-0f267131f158 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:05.422733 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59f306f5-8d5a-4e3c-b58c-0f267131f158 None None] Pushing event updated for resources: {'Port': ['ID=8f9fcefe-e0b6-4098-b5b7-db33570e1fd2,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:05.483801 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-9812fbc1-da01-4097-bf7a-ab130242f244 None None] Provisioning complete for port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:05.484484 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-9812fbc1-da01-4097-bf7a-ab130242f244 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:05.537490 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-ff48de77-700e-46dc-a912-1130cf0a395c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:05.543145 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-ff48de77-700e-46dc-a912-1130cf0a395c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.0979705 Nov 12 15:00:05.634806 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 4, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'gw_port': {'id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:93:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T15:00:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '8f9fcefe-e0b6-4098-b5b7-db33570e1fd2', 'name': '', 'network_id': '36029b5a-89ee-422a-a728-17855197aded', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'mac_address': 'fa:16:3e:64:5e:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '39333609-040c-402e-935a-d3f3817a37b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:59Z', 'updated_at': '2021-11-12T15:00:05Z', 'revision_number': 4, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'subnets': [{'id': '39333609-040c-402e-935a-d3f3817a37b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:05.695239 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b21bfc3-331d-4626-9e9b-a5dc6077de3f None None] The sync data for ids ['1b7beec1-89da-42c3-9717-c12a2e772716'] in dv-cinder-776422-5-iscsi is: [{'id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 4, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'gw_port': {'id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:93:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T15:00:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '8f9fcefe-e0b6-4098-b5b7-db33570e1fd2', 'name': '', 'network_id': '36029b5a-89ee-422a-a728-17855197aded', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'mac_address': 'fa:16:3e:64:5e:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '39333609-040c-402e-935a-d3f3817a37b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:59Z', 'updated_at': '2021-11-12T15:00:05Z', 'revision_number': 4, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'subnets': [{'id': '39333609-040c-402e-935a-d3f3817a37b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:05.710299 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-55f7f893-441d-42b5-92e4-c3b79bd4353c service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0710399 Nov 12 15:00:05.717738 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Deleting port 6404f751-2813-4de0-aa94-89a7df49823a {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:00:05.718084 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:05.882996 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] For port 6404f751-2813-4de0-aa94-89a7df49823a, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=6404f751-2813-4de0-aa94-89a7df49823a,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:05.883745 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:05.982924 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-424176cf-04bf-45ca-99bc-6d2142c87bbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:05.984595 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-424176cf-04bf-45ca-99bc-6d2142c87bbd service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 1099 time: 0.1714945 Nov 12 15:00:06.254051 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1979b379-2a8d-46b5-a055-75e66808fc63 req-95036f01-0b9d-48fb-89bd-c4a5e4f78733 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:06.255748 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1979b379-2a8d-46b5-a055-75e66808fc63 req-95036f01-0b9d-48fb-89bd-c4a5e4f78733 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 946 time: 0.2282422 Nov 12 15:00:06.261614 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-0ac3b3d3-8e6d-43c7-a6a0-77e6d8a39d3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:06.263186 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-0ac3b3d3-8e6d-43c7-a6a0-77e6d8a39d3f service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.2555029 Nov 12 15:00:06.376901 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:06.377408 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:06.377829 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Floating IP 48ff26c1-7f96-4175-96c9-7a0a9c6a28ba disassociated. External IP: 172.27.3.9, port: 6404f751-2813-4de0-aa94-89a7df49823a. Nov 12 15:00:06.378277 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Calling delete_port for 6404f751-2813-4de0-aa94-89a7df49823a owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:00:06.438373 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1979b379-2a8d-46b5-a055-75e66808fc63 req-229ebc13-713a-4f0f-8ef4-5009e8834b71 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=ca2a62a9-52f5-4a03-a51d-b483a8433480&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1719911 Nov 12 15:00:06.446590 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-3525bbce-7bf7-4980-9e9b-d9e8b7a1da03 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d2b7f476-dd48-4efe-b149-aad19da5171f HTTP/1.1" status: 200 len: 1001 time: 0.1726115 Nov 12 15:00:06.551898 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-6ebbf471-861e-428b-bb0b-0446a3a7c863 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:06.553336 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-6ebbf471-861e-428b-bb0b-0446a3a7c863 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0776372 Nov 12 15:00:06.655567 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-95cc6eae-b0f3-432f-9a4b-62d8b0f3dd54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:06.657082 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-95cc6eae-b0f3-432f-9a4b-62d8b0f3dd54 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0961905 Nov 12 15:00:06.710273 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:06.747780 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event deleted for resources: {'Port': ['ID=6404f751-2813-4de0-aa94-89a7df49823a,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:06.865055 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-00aabb58-3b40-4260-bb7a-1e1e463f7c2a service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1976540 Nov 12 15:00:06.936227 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:06.988362 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Router a08d9f45-c652-4276-867c-ab77c8f81aef has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:00:07.034897 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:07.036859 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:07.122536 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-75dccf5b-5449-43c4-8ba9-93d51b25241c req-a6eee57b-f604-4d37-bde0-33f0060d9818 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2483368 Nov 12 15:00:07.205564 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:07.221712 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] Sync routers for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:07.235855 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:07.236950 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:07.274609 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] No DVR routers for this DVR port 6404f751-2813-4de0-aa94-89a7df49823a on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:00:07.277872 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:07.282090 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea8e004d-c73f-4b7e-8b66-dc14b45d5c8e req-e7e373a6-7b9d-4aba-a582-eabd275c88bc tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "DELETE /v2.0/ports/6404f751-2813-4de0-aa94-89a7df49823a HTTP/1.1" status: 204 len: 173 time: 1.7310541 Nov 12 15:00:07.282576 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'name': 'network-vif-deleted', 'tag': '6404f751-2813-4de0-aa94-89a7df49823a'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:07.285575 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bbce0a56-f31b-48ff-a549-ab6ea321efce" -d '{"events": [{"server_uuid": "750b2499-ec22-4102-9133-f6a0fdb713d0", "name": "network-vif-deleted", "tag": "6404f751-2813-4de0-aa94-89a7df49823a"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:07.379493 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bdaa6381-fc16-42e2-b6f8-7ccae6eccb13 x-openstack-request-id: req-bdaa6381-fc16-42e2-b6f8-7ccae6eccb13 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:07.382186 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "750b2499-ec22-4102-9133-f6a0fdb713d0", "name": "network-vif-deleted", "tag": "6404f751-2813-4de0-aa94-89a7df49823a", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:07.382661 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-bdaa6381-fc16-42e2-b6f8-7ccae6eccb13 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:07.383300 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '750b2499-ec22-4102-9133-f6a0fdb713d0', 'name': 'network-vif-deleted', 'tag': '6404f751-2813-4de0-aa94-89a7df49823a', 'status': 'completed', 'code': 200} Nov 12 15:00:07.430525 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:07.685272 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-86ec2cbb-4a9a-477e-8844-e32fb1adb20b req-47cd0e85-cded-40d0-931d-350a41d257a0 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=750b2499-ec22-4102-9133-f6a0fdb713d0 HTTP/1.1" status: 200 len: 210 time: 0.0289528 Nov 12 15:00:07.713054 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:07.758495 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] Checking router: a08d9f45-c652-4276-867c-ab77c8f81aef for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:07.768994 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:07.769717 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:07.951110 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:08.260535 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:08.290063 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b1d33b6-b658-4d84-adaa-319e2a8d60dc None None] The sync data for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi is: [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:08.766007 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2294368-a8b4-4099-bbbe-494f01672708 None None] New status for floating IP 48ff26c1-7f96-4175-96c9-7a0a9c6a28ba: DOWN {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:00:08.820755 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60104) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:08.923112 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-47ffdb5a-b049-4f71-935a-3f5c35511fd8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:08.961440 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-47ffdb5a-b049-4f71-935a-3f5c35511fd8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:09.061320 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-47ffdb5a-b049-4f71-935a-3f5c35511fd8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:09.063940 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-47ffdb5a-b049-4f71-935a-3f5c35511fd8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:09.065118 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-47ffdb5a-b049-4f71-935a-3f5c35511fd8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "DELETE /v2.0/security-groups/ca2a62a9-52f5-4a03-a51d-b483a8433480 HTTP/1.1" status: 204 len: 168 time: 0.2427559 Nov 12 15:00:09.070674 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60106) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:09.089642 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.api.v2.resource [None req-da1fa09f-0983-4eaa-b362-2c9f5b47f629 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] show failed (client error): The resource could not be found. Nov 12 15:00:09.093680 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-da1fa09f-0983-4eaa-b362-2c9f5b47f629 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups/ca2a62a9-52f5-4a03-a51d-b483a8433480 HTTP/1.1" status: 404 len: 347 time: 0.0190382 Nov 12 15:00:09.093905 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60108) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:09.102198 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ffdb5a-b049-4f71-935a-3f5c35511fd8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca2a62a9-52f5-4a03-a51d-b483a8433480,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:09.291223 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Deleting port 5d7463a2-a60f-4f0f-a412-d028fe77defe {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:00:09.291573 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:09.438388 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:09.439231 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:09.455111 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Calling delete_port for 5d7463a2-a60f-4f0f-a412-d028fe77defe owned by network:floatingip {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:00:09.618626 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:09.653576 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event deleted for resources: {'Port': ['ID=5d7463a2-a60f-4f0f-a412-d028fe77defe,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:09.745176 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:09.745696 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:09.750435 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-ded42051-8394-403b-b7cb-b3059a6b67e2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "DELETE /v2.0/floatingips/48ff26c1-7f96-4175-96c9-7a0a9c6a28ba HTTP/1.1" status: 204 len: 168 time: 0.6519489 Nov 12 15:00:10.326547 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 6404f751-2813-4de0-aa94-89a7df49823a no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:00:10.350482 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 6404f751-2813-4de0-aa94-89a7df49823a {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:00:10.350941 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 6404f751-2813-4de0-aa94-89a7df49823a not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:00:10.375333 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60124) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:10.380281 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-2eaf4dca-8a6e-4c29-a345-6dc2af87839e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1555358162', 'description': 'tempest-description--1448966885'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:10.407054 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2eaf4dca-8a6e-4c29-a345-6dc2af87839e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.492865 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2eaf4dca-8a6e-4c29-a345-6dc2af87839e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.498104 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2eaf4dca-8a6e-4c29-a345-6dc2af87839e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.525407 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2eaf4dca-8a6e-4c29-a345-6dc2af87839e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.529374 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-2eaf4dca-8a6e-4c29-a345-6dc2af87839e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1503365 Nov 12 15:00:10.529709 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60130) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:10.534820 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-3c886131-be90-44c6-bed5-619f5f2082a9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'security_group_rule': {'security_group_id': '79e7e172-0c31-44bf-9a13-0d36bf1eec5e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:10.554973 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eaf4dca-8a6e-4c29-a345-6dc2af87839e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'SecurityGroup': ['ID=79e7e172-0c31-44bf-9a13-0d36bf1eec5e,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:10.582931 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c886131-be90-44c6-bed5-619f5f2082a9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.656300 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c886131-be90-44c6-bed5-619f5f2082a9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.660402 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c886131-be90-44c6-bed5-619f5f2082a9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.679762 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c886131-be90-44c6-bed5-619f5f2082a9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7e12b36b-a830-459d-a0f9-da54784424e9,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:10.692867 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3c886131-be90-44c6-bed5-619f5f2082a9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.697753 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-3c886131-be90-44c6-bed5-619f5f2082a9 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1640494 Nov 12 15:00:10.698217 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60136) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:10.704860 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-9734ef95-a4b9-4a62-bc30-08091c41bfb1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'security_group_rule': {'security_group_id': '79e7e172-0c31-44bf-9a13-0d36bf1eec5e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:10.743185 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9734ef95-a4b9-4a62-bc30-08091c41bfb1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.816286 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9734ef95-a4b9-4a62-bc30-08091c41bfb1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.820351 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9734ef95-a4b9-4a62-bc30-08091c41bfb1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.836209 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9734ef95-a4b9-4a62-bc30-08091c41bfb1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0ba70a74-3901-484c-a216-abb090e0197b,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:10.847231 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9734ef95-a4b9-4a62-bc30-08091c41bfb1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.848480 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-9734ef95-a4b9-4a62-bc30-08091c41bfb1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1472762 Nov 12 15:00:10.852201 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60138) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:10.858607 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'floatingip': {'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:10.884403 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:10.999218 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:11.119767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Allocated IP 172.27.3.179 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/744fb487-5ec9-46c5-aff9-8b3241b1bd20) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:11.262806 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:11.301252 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:11.366973 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:11.371923 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'Port': ['ID=744fb487-5ec9-46c5-aff9-8b3241b1bd20,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:11.385072 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:11.390780 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:11.512952 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:11.569555 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:11.793883 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:11.798906 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:11.875808 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'Port': ['ID=744fb487-5ec9-46c5-aff9-8b3241b1bd20,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:11.893906 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:11.912623 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:11.920706 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f7ebda23-837d-4d85-ac81-e1e6c9264bb4 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.0672102 Nov 12 15:00:12.130341 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-77919ea2-56e1-4f4e-b6b4-c1e5736eb274 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-securitygroup--1555358162&fields=id&tenant_id=e9ecca05e4af49c9b46cc186e0517c9c HTTP/1.1" status: 200 len: 267 time: 0.0661449 Nov 12 15:00:12.264987 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-f00c1a3a-1c68-48b9-a9a1-b9714fe99a63 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:12.267372 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-f00c1a3a-1c68-48b9-a9a1-b9714fe99a63 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 811 time: 0.1280298 Nov 12 15:00:12.290045 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-573603c4-5524-4517-a2a8-d84c5b840c6b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/quotas/e9ecca05e4af49c9b46cc186e0517c9c HTTP/1.1" status: 200 len: 375 time: 0.0159233 Nov 12 15:00:12.361482 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-9811539b-dc36-46dc-93ee-ad52e94647b2 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0654323 Nov 12 15:00:12.525305 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-a6c8cda4-4820-4631-9d09-29fbbece5457 service neutron] 10.222.0.61 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1478190 Nov 12 15:00:12.634197 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-0e1aad5c-b0b3-44e9-8e23-82de1eb5045f service neutron] 10.222.0.61 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1027586 Nov 12 15:00:12.884372 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6150290e-edd5-4844-88ab-f93ee25b5706 req-08b5a541-1907-4651-be1b-9c1ee1470ef7 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 210 time: 0.0507407 Nov 12 15:00:13.046004 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1e46cfc-3a1e-45bb-a9cb-05bd3914552b req-7c73e10a-e252-4b41-8e99-7405289e7c76 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:13.047533 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d1e46cfc-3a1e-45bb-a9cb-05bd3914552b req-7c73e10a-e252-4b41-8e99-7405289e7c76 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 946 time: 0.0531001 Nov 12 15:00:13.107048 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d1e46cfc-3a1e-45bb-a9cb-05bd3914552b req-9968f38a-74f7-49de-8b10-621336f1b527 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521460 Nov 12 15:00:13.628854 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-7c8e6307-8ff0-4cde-af25-34d24e498b7a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:13.630294 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-7c8e6307-8ff0-4cde-af25-34d24e498b7a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/networks?id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 200 len: 814 time: 0.1150215 Nov 12 15:00:13.646176 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-757fca29-d679-4ad9-8c88-f1a9b65c5187 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/quotas/081b60b81cf04cd28b26a5b5cf5d5888 HTTP/1.1" status: 200 len: 375 time: 0.0097468 Nov 12 15:00:13.703634 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-40c24316-1a57-482a-95b1-ff9d95c0706a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0516796 Nov 12 15:00:13.810415 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-6fa242e9-8e7d-4f92-9dcc-94243b16e3db service neutron] 10.222.0.61 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828600 Nov 12 15:00:13.911176 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-c74eff82-e0ed-409e-adfb-531bf9fbee0b service neutron] 10.222.0.61 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947261 Nov 12 15:00:14.148914 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2f4a12d6-8ba1-49a9-bdd2-b601d7619b91 req-e277276c-afe3-4c6d-96e0-56d068b07a15 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 210 time: 0.0413914 Nov 12 15:00:14.288688 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b322f60a-c6e7-48fc-a7d3-12fbf485058e req-9b853a63-50c6-478c-a474-6f48baa931fe tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 210 time: 0.0551314 Nov 12 15:00:14.310590 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c5465e-716a-455d-bb65-aceba00fea88 req-26f55eed-1a18-4e4f-a072-a3e0b2d36bfa tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:14.312600 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-36c5465e-716a-455d-bb65-aceba00fea88 req-26f55eed-1a18-4e4f-a072-a3e0b2d36bfa tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 946 time: 0.0875204 Nov 12 15:00:14.378428 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-72c61acc-3f33-4ef5-897c-5e14f8a28561 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:14.380299 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-72c61acc-3f33-4ef5-897c-5e14f8a28561 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 811 time: 0.4588158 Nov 12 15:00:14.400716 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-36c5465e-716a-455d-bb65-aceba00fea88 req-0b36a250-b4f2-41a4-9070-a5ceeebf80a3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0778596 Nov 12 15:00:14.481518 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-f58d6c95-f6aa-4972-b803-e8de2592bf85 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e9ecca05e4af49c9b46cc186e0517c9c HTTP/1.1" status: 200 len: 380 time: 0.0884001 Nov 12 15:00:14.492490 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'port': {'device_id': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'admin_state_up': True, 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'security_groups': ['79e7e172-0c31-44bf-9a13-0d36bf1eec5e']}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:14.653154 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-5fc75bcf-b743-427d-b0f8-0ed00d804267 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:14.655692 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-5fc75bcf-b743-427d-b0f8-0ed00d804267 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 946 time: 0.0861044 Nov 12 15:00:14.702249 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Made reservation on behalf of e9ecca05e4af49c9b46cc186e0517c9c for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:00:14.705767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:14.863229 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Deleting port d2b7f476-dd48-4efe-b149-aad19da5171f {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:00:14.863567 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:14.930769 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Allocated IP 172.20.0.9 (cf063ae4-6fb7-44b8-9c9f-984a39a87f66/f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2/dd7d017f-a94d-4100-a980-fc29d066f333) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:14.999407 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] For port d2b7f476-dd48-4efe-b149-aad19da5171f, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d2b7f476-dd48-4efe-b149-aad19da5171f,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:14.999670 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:15.278810 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:15.345200 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-286d6fce-e6f9-4641-b3c6-1bac7e35a829 req-a5d1b406-5d4e-43db-8244-9785b646040b tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 210 time: 0.0905142 Nov 12 15:00:15.395580 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-56b3dcd8-e91a-4c03-96b0-62cd41de941c req-93b27713-ed16-43e5-9ab4-4ea0c0520334 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 210 time: 0.0393190 Nov 12 15:00:15.397744 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:15.397963 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:15.398326 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Floating IP f9a56ed8-901e-4103-8243-d3099350c0b2 disassociated. External IP: 172.27.3.238, port: d2b7f476-dd48-4efe-b149-aad19da5171f. Nov 12 15:00:15.398630 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Calling delete_port for d2b7f476-dd48-4efe-b149-aad19da5171f owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:00:15.407513 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:15.535440 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-12396e13-2716-4064-affc-b2d67e9c38be tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:15.537076 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-12396e13-2716-4064-affc-b2d67e9c38be tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.86 "GET /v2.0/networks?id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 200 len: 814 time: 0.3524432 Nov 12 15:00:15.540485 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:15.572154 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'port': {'device_id': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'admin_state_up': True, 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:15.580694 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:15.586983 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event updated for resources: {'Port': ['ID=dd7d017f-a94d-4100-a980-fc29d066f333,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:15.600614 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:15.741804 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-334fa21f-111d-40d6-9fb7-556009d4154a req-31b3fc07-20df-4764-9c3a-c36ec01fdaa5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:15.750022 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-334fa21f-111d-40d6-9fb7-556009d4154a req-31b3fc07-20df-4764-9c3a-c36ec01fdaa5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 946 time: 0.2610433 Nov 12 15:00:15.767469 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:15.768591 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:15.911929 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-576e6cbf-cfef-4afc-aa64-e75d300d8c0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4234383 Nov 12 15:00:16.024324 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-ac2ebcc0-a05f-47f7-8980-bbefc00a6077 None None] Provisioning complete for port dd7d017f-a94d-4100-a980-fc29d066f333 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:16.024916 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ac2ebcc0-a05f-47f7-8980-bbefc00a6077 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:16.041667 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-334fa21f-111d-40d6-9fb7-556009d4154a req-1ead0fcb-92c1-4cad-8442-836186572844 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=35291230-5c54-46fa-a3c4-6ead2197bb81&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2900388 Nov 12 15:00:16.071744 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-ac2ebcc0-a05f-47f7-8980-bbefc00a6077 None None] Port dd7d017f-a94d-4100-a980-fc29d066f333 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:16.095484 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:16.301537 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event deleted for resources: {'Port': ['ID=d2b7f476-dd48-4efe-b149-aad19da5171f,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:16.334548 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:00:16.340671 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Router 2b5b59a1-46c8-4703-94e6-adf835fba661 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:00:16.346891 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Made reservation on behalf of 081b60b81cf04cd28b26a5b5cf5d5888 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:00:16.350552 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:16.484718 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-45a6c0b1-d974-43cf-922b-13d3ecbf075c req-bb13ce36-63fc-4a3a-a38e-1274341bc837 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 210 time: 0.0391581 Nov 12 15:00:16.596373 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60300) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:16.663086 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-11a533c7-1b02-4e0b-904f-67615bef4ca6 admin admin] Deleting subnet e3c6e311-60aa-48d4-9047-fdea4100c035 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:00:16.663879 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-924d1f3f-9a1c-42d6-9fd1-778d1b0855cc req-d1cb5792-dd19-4a8f-a18e-0781693e83ef tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:16.665474 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-924d1f3f-9a1c-42d6-9fd1-778d1b0855cc req-d1cb5792-dd19-4a8f-a18e-0781693e83ef tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 931 time: 0.1636305 Nov 12 15:00:16.666499 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-11a533c7-1b02-4e0b-904f-67615bef4ca6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:16.670475 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:16.689734 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] Sync routers for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:16.715913 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:16.718109 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:16.757457 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-11a533c7-1b02-4e0b-904f-67615bef4ca6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:16.763531 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Allocated IP 172.20.0.5 (fb9a4b4b-b9a5-4585-a360-1f294aeb3903/f4fb6dc5-7523-48a4-a992-01a08cf2fcf4/37ce8a4b-01d0-4c8c-8665-8f6627848b39) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:16.812240 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] No DVR routers for this DVR port d2b7f476-dd48-4efe-b149-aad19da5171f on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:00:16.815281 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:16.821025 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69e4984f-b0ae-43cb-9364-0715b0ab007e req-1d51856a-1360-4977-a9cb-db386d9726f6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "DELETE /v2.0/ports/d2b7f476-dd48-4efe-b149-aad19da5171f HTTP/1.1" status: 204 len: 173 time: 2.1529820 Nov 12 15:00:16.832069 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-deleted', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:16.835340 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a23e9a43-d1be-4479-a5c5-1490726625ef" -d '{"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-deleted", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:16.869513 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-11a533c7-1b02-4e0b-904f-67615bef4ca6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:16.888865 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-924d1f3f-9a1c-42d6-9fd1-778d1b0855cc req-21aba77e-4054-48d2-a721-5fd993f349ed tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2144902 Nov 12 15:00:16.914276 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19b0424e-8fdf-4a05-9234-dd80eb560ade x-openstack-request-id: req-19b0424e-8fdf-4a05-9234-dd80eb560ade {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:16.914581 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "82360b9e-d05e-4010-8b74-d862c5e66562", "name": "network-vif-deleted", "tag": "d2b7f476-dd48-4efe-b149-aad19da5171f", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:16.914836 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-19b0424e-8fdf-4a05-9234-dd80eb560ade {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:16.915981 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '82360b9e-d05e-4010-8b74-d862c5e66562', 'name': 'network-vif-deleted', 'tag': 'd2b7f476-dd48-4efe-b149-aad19da5171f', 'status': 'completed', 'code': 200} Nov 12 15:00:16.954489 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-11a533c7-1b02-4e0b-904f-67615bef4ca6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:16.962093 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:16.969059 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-11a533c7-1b02-4e0b-904f-67615bef4ca6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:16.972925 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-11a533c7-1b02-4e0b-904f-67615bef4ca6 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/e3c6e311-60aa-48d4-9047-fdea4100c035 HTTP/1.1" status: 204 len: 168 time: 0.3754826 Nov 12 15:00:16.975347 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60304) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:17.004566 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a533c7-1b02-4e0b-904f-67615bef4ca6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e3c6e311-60aa-48d4-9047-fdea4100c035,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:17.086690 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.148796 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.207571 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.211418 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.237996 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-99f6a725-8998-4e21-9668-3720b59e3205 req-6bbb18a6-7b05-4c30-8e4f-bcd48b31fd76 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0391867 Nov 12 15:00:17.250368 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['52b14bae-7f5f-4554-a082-87deb1ef1096']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:17.261795 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8d885094-f225-46f0-a8f7-af9d90c9da56') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:17.262515 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8d885094-f225-46f0-a8f7-af9d90c9da56') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:17.279228 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:17.282647 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:17.289136 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:17.294840 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.309997 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.319681 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] Releasing vlan 609 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:00:17.332439 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.357708 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:17.358959 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.373267 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:17.392890 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8288124 Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:00:17.404978 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:00:17.408183 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bbf7c53-3673-4cd7-804e-fe4b7d3f67d6 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'Port': ['ID=37ce8a4b-01d0-4c8c-8665-8f6627848b39,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:17.408618 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.426241 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] Checking router: 2b5b59a1-46c8-4703-94e6-adf835fba661 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:17.429230 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.434880 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] 10.222.0.61 "DELETE /v2.0/networks/52b14bae-7f5f-4554-a082-87deb1ef1096 HTTP/1.1" status: 204 len: 168 time: 0.4584305 Nov 12 15:00:17.440360 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:17.441170 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:17.451614 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27dbe279-9e2f-4c14-bb83-998a5ccca017 admin admin] Pushing event deleted for resources: {'Network': ['ID=52b14bae-7f5f-4554-a082-87deb1ef1096,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:17.648813 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:17.685524 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3d4ad4-b4e7-4872-8316-cda3e1a7861f req-a83ec5f5-c06e-43b6-a8e9-146f37db5692 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:17.687816 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4b3d4ad4-b4e7-4872-8316-cda3e1a7861f req-a83ec5f5-c06e-43b6-a8e9-146f37db5692 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 931 time: 0.0813835 Nov 12 15:00:17.765766 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60312) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:17.783818 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-ec0e66a3-289f-4755-86a8-5c32622f0fb4 None None] Provisioning complete for port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:17.784210 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ec0e66a3-289f-4755-86a8-5c32622f0fb4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.788792 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4b3d4ad4-b4e7-4872-8316-cda3e1a7861f req-817cf23a-70ae-40f1-95c5-9e544fed570e tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838532 Nov 12 15:00:17.824158 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-bdfcef72-ef69-4325-a45f-250672e9ce4b admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=71f7babcbb2e48a899f3b931fbcb2c03&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0545559 Nov 12 15:00:17.825021 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60314) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:17.897227 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81e3ec29-d68b-4c39-a2de-c3d2b4fcffa8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:17.932006 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81e3ec29-d68b-4c39-a2de-c3d2b4fcffa8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:18.012094 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-ec0e66a3-289f-4755-86a8-5c32622f0fb4 None None] Port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:18.018409 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81e3ec29-d68b-4c39-a2de-c3d2b4fcffa8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:18.022649 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81e3ec29-d68b-4c39-a2de-c3d2b4fcffa8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:18.023977 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-81e3ec29-d68b-4c39-a2de-c3d2b4fcffa8 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/74f530ff-ef50-475b-b409-b28efb99f0d0 HTTP/1.1" status: 204 len: 168 time: 0.1979403 Nov 12 15:00:18.050982 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81e3ec29-d68b-4c39-a2de-c3d2b4fcffa8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74f530ff-ef50-475b-b409-b28efb99f0d0,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:18.086533 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe29f0b-484c-4723-ab76-00696910a4d4 req-1714853e-5956-49a7-88b4-5c5b3715e7cb tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:18.089141 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bbe29f0b-484c-4723-ab76-00696910a4d4 req-1714853e-5956-49a7-88b4-5c5b3715e7cb tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 931 time: 0.1256266 Nov 12 15:00:18.144897 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:18.168924 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bbe29f0b-484c-4723-ab76-00696910a4d4 req-3acf01a9-d634-4c5b-856d-c4e8dfaa3d16 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0701127 Nov 12 15:00:18.185662 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ce3cdd7-2d22-44a5-b385-3d259064a3dd None None] The sync data for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi is: [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:18.348175 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d2b7f476-dd48-4efe-b149-aad19da5171f no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:00:18.373979 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: d2b7f476-dd48-4efe-b149-aad19da5171f {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:00:18.374623 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d2b7f476-dd48-4efe-b149-aad19da5171f not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:00:18.383766 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f01afcad-0c71-4b44-b2d5-07ccc3691baf req-8632a5dc-edb3-4d3a-8205-a7a9dd0b677c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0345585 Nov 12 15:00:18.563382 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6c7d665-8a41-425a-b175-98479b70903c None None] New status for floating IP f9a56ed8-901e-4103-8243-d3099350c0b2: DOWN {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:00:18.894453 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60344) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:18.915814 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae62cdb0-4375-402b-ade0-f2499ebc572a req-555a82a1-ec1f-4198-b44d-57dff870be8a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:18.917613 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ae62cdb0-4375-402b-ade0-f2499ebc572a req-555a82a1-ec1f-4198-b44d-57dff870be8a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 931 time: 0.0576832 Nov 12 15:00:18.998182 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ae62cdb0-4375-402b-ade0-f2499ebc572a req-77fddbb5-2d5b-4f46-a8be-cb9fc92a5a63 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689528 Nov 12 15:00:19.044160 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1743828636-network', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:19.073441 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Made reservation on behalf of 49070bd2a8b542b3801c73a224b4bba5 for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:00:19.075775 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.086802 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.174011 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.179287 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.205992 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 623} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 15:00:19.217152 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23a8b7cf-436d-48b1-96e4-f4effde97318,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:19.222092 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.222418 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Added segment 01124735-d9c7-40e8-a61c-2a8529779c8d of type vlan for network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b Nov 12 15:00:19.240396 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.240904 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.241302 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.241795 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.242210 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.242503 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.242831 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.243368 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.243728 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.244055 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.244408 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.244729 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:19.294163 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.329597 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.331774 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:19.332652 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.357463 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6cb4974-c5f1-4131-84d4-b376f8c2fd27 req-19b2a2fd-3b3b-4163-bc5f-b848c5397949 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:19.359644 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c6cb4974-c5f1-4131-84d4-b376f8c2fd27 req-19b2a2fd-3b3b-4163-bc5f-b848c5397949 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 931 time: 0.0668752 Nov 12 15:00:19.404381 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5080280 Nov 12 15:00:19.407324 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60350) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:19.413602 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Request body: {'subnet': {'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1743828636-subnet', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'ip_version': 4}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:19.418213 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f8f190-7a98-4bea-b340-f1005aa4014f admin admin] Pushing event updated for resources: {'Network': ['ID=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:19.434362 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 15:00:19.436781 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c6cb4974-c5f1-4131-84d4-b376f8c2fd27 req-41b7d0d2-d322-4153-adaa-3481a3206d56 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0706246 Nov 12 15:00:19.462100 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Made reservation on behalf of 49070bd2a8b542b3801c73a224b4bba5 for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:00:19.464483 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5528411'] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.553753 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b712a43d-8151-4f2b-b700-476845e2f4ca req-a2689ade-7985-422b-98e0-ab7ec8f34a41 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0631564 Nov 12 15:00:19.685359 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5822845', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5528393'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:19.981594 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Pushing event updated for resources: {'Subnet': ['ID=0d076ecb-e243-4855-ace2-0ad087866ab5,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:20.006642 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Checking segment: {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:20.007070 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Network hostable DHCP agents. Network: ca05832f-5b12-4ac8-b78f-b968aa7e8f1b, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 15:00:20.028812 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 15:00:20.039232 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, ca05832f-5b12-4ac8-b78f-b968aa7e8f1b) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:20.047601 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1b44528-f14b-47da-a7ed-7c2aa0a7a43d None None] Network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:00:20.055252 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:20.055879 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.075262 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-79697032-8212-43cc-942b-800b0f9649ee admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6664939 Nov 12 15:00:20.077829 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60356) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:20.082585 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:20.117369 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.118367 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.225313 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-086994b6-c0ee-4037-97f4-9c77f3b221c0 req-72ae7e7b-c3c4-4e95-b5f9-71cf39624732 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:20.226905 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-086994b6-c0ee-4037-97f4-9c77f3b221c0 req-72ae7e7b-c3c4-4e95-b5f9-71cf39624732 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 931 time: 0.1194174 Nov 12 15:00:20.228473 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.251988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 15:00:20.253247 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.401569 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.407689 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-086994b6-c0ee-4037-97f4-9c77f3b221c0 req-56419144-242a-4dcc-bba3-c8849f6c14eb tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1716714 Nov 12 15:00:20.416323 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Allocated IP 172.20.0.2 (ca05832f-5b12-4ac8-b78f-b968aa7e8f1b/0d076ecb-e243-4855-ace2-0ad087866ab5/0919ba46-31b7-4b8e-9509-d367d4bbabdb) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:20.638642 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94652cf3-85d9-4977-8ef1-4e8e7d7926e1 req-1d1c814e-31f4-442d-9acd-3b6e7802d867 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:20.641010 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.643538 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-94652cf3-85d9-4977-8ef1-4e8e7d7926e1 req-1d1c814e-31f4-442d-9acd-3b6e7802d867 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 931 time: 0.0873539 Nov 12 15:00:20.650044 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.737862 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Pushing event updated for resources: {'Port': ['ID=0919ba46-31b7-4b8e-9509-d367d4bbabdb,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:20.750118 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-94652cf3-85d9-4977-8ef1-4e8e7d7926e1 req-1758a7b5-55d2-49c4-ad82-56e9c888ab45 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0990164 Nov 12 15:00:20.751079 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:20.757737 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:20.763020 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:20.851431 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Attempting to bind port 0919ba46-31b7-4b8e-9509-d367d4bbabdb on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:20.851809 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Attempting to bind port 0919ba46-31b7-4b8e-9509-d367d4bbabdb by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:20.852175 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Attempting to bind port 0919ba46-31b7-4b8e-9509-d367d4bbabdb on network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:20.860893 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:20.860893 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Checking segment: {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:20.860893 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.860893 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Bound using segment: {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:20.860893 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Bound port: 0919ba46-31b7-4b8e-9509-d367d4bbabdb, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:20.861533 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.941700 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] For port 0919ba46-31b7-4b8e-9509-d367d4bbabdb, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:20.947157 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] For port 0919ba46-31b7-4b8e-9509-d367d4bbabdb, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=0919ba46-31b7-4b8e-9509-d367d4bbabdb,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:20.953281 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:20.960692 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-913ec439-a6c8-4b30-ab94-3811b940d014 req-ea008d73-ff93-47dd-9ef3-1e49e7f8352f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0377796 Nov 12 15:00:21.039879 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95aa4f63-803c-4f3d-b425-03e478f75320 None None] Pushing event updated for resources: {'Port': ['ID=0919ba46-31b7-4b8e-9509-d367d4bbabdb,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:21.063380 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:21.137171 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:21.263938 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Allocated IP 172.27.3.86 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/d65653f6-11ec-4231-a8a2-0a1f72ba1870) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:21.411215 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:21.448860 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:21.484600 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:21.489226 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:21.495795 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:21.524873 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Pushing event updated for resources: {'Port': ['ID=d65653f6-11ec-4231-a8a2-0a1f72ba1870,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:21.550077 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9554da-ac0d-4552-ab3e-5968e3dc6c72 req-af12172d-18b3-44b2-8138-7845f92e5e79 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:21.553574 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5f9554da-ac0d-4552-ab3e-5968e3dc6c72 req-af12172d-18b3-44b2-8138-7845f92e5e79 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 931 time: 0.0540514 Nov 12 15:00:21.625767 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5f9554da-ac0d-4552-ab3e-5968e3dc6c72 req-9e4766b4-ca32-49e1-a4b2-9aa2419dcbf8 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670307 Nov 12 15:00:21.894371 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:21.944468 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c615f41d-d862-4241-becf-27a211ac970a req-ed74f69d-789a-46dc-ac5b-a500c2a54269 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:21.946029 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c615f41d-d862-4241-becf-27a211ac970a req-ed74f69d-789a-46dc-ac5b-a500c2a54269 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 931 time: 0.1082098 Nov 12 15:00:22.053735 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c615f41d-d862-4241-becf-27a211ac970a req-2ebe450b-6cc4-4622-820d-93f8997a3424 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0986052 Nov 12 15:00:22.132426 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d5b8f346-f6c9-4869-9bd7-5ed22d484e59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:22.179804 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:22.192562 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8d6d2f11-f7f8-44b0-a2b2-7877bbb762f1 req-f2a33abd-089f-4333-990e-83aad3c19f1e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0736544 Nov 12 15:00:22.228210 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74abed48-0d2b-429c-83ac-b8f12e28e3b3 None None] Network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:00:22.314687 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-f1217140-6f8e-4a56-8f72-08009f9afcb3 None None] Provisioning complete for port 0919ba46-31b7-4b8e-9509-d367d4bbabdb triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:22.315614 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f1217140-6f8e-4a56-8f72-08009f9afcb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:22.359011 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101617) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 15:00:22.494191 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:22.497738 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f1217140-6f8e-4a56-8f72-08009f9afcb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:22.521805 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Sync routers for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:22.524884 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] Publish callbacks [] for router, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:22.528725 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-099bcbbe-ac30-4194-9ddc-de282d1aa7c0 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.4472737 Nov 12 15:00:22.529969 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60370) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:22.546616 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-f1217140-6f8e-4a56-8f72-08009f9afcb3 None None] For port 0919ba46-31b7-4b8e-9509-d367d4bbabdb, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=0919ba46-31b7-4b8e-9509-d367d4bbabdb,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:22.547717 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:22.548367 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:22.608835 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f1217140-6f8e-4a56-8f72-08009f9afcb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:22.727462 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1217140-6f8e-4a56-8f72-08009f9afcb3 None None] Pushing event updated for resources: {'Port': ['ID=0919ba46-31b7-4b8e-9509-d367d4bbabdb,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:22.800059 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:22.873320 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54eaa495-b02f-45e8-88e6-ab2cdad527fa req-f4cc2f9b-e40c-4b95-a01a-346248b56a9f tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:22.883669 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-54eaa495-b02f-45e8-88e6-ab2cdad527fa req-f4cc2f9b-e40c-4b95-a01a-346248b56a9f tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 931 time: 0.1120608 Nov 12 15:00:23.011079 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-54eaa495-b02f-45e8-88e6-ab2cdad527fa req-90b13552-a864-421c-9c34-09b9f06fb4e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1196744 Nov 12 15:00:23.020300 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0919ba46-31b7-4b8e-9509-d367d4bbabdb up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:23.244904 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-720d5892-8371-4560-85f8-89629fe038e6 None None] Provisioning complete for port 0919ba46-31b7-4b8e-9509-d367d4bbabdb triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:23.245670 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-720d5892-8371-4560-85f8-89629fe038e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:23.288102 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:23.311304 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-36117dc8-02bf-4474-a488-4858f31dd17d req-6e55994b-aa20-42ab-be1a-e926aa32aad4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0284002 Nov 12 15:00:23.317439 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8107f9a2-de17-411a-a7d4-59fe8b985aeb req-de26404f-9228-4695-b18c-2ddcdd7e55f1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:23.319071 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8107f9a2-de17-411a-a7d4-59fe8b985aeb req-de26404f-9228-4695-b18c-2ddcdd7e55f1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 931 time: 0.1133463 Nov 12 15:00:23.382055 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 0919ba46-31b7-4b8e-9509-d367d4bbabdb triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:23.382055 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:23.457066 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8107f9a2-de17-411a-a7d4-59fe8b985aeb req-f59479cf-d5a7-489a-ac38-49cd85d27c0a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1278024 Nov 12 15:00:23.481645 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:21Z', 'revision_number': 3, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:23.523604 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Allocated IP 172.20.0.1 (ca05832f-5b12-4ac8-b78f-b968aa7e8f1b/0d076ecb-e243-4855-ace2-0ad087866ab5/41ed57ec-72c3-4a85-9fb7-dccd23c0a16c) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:23.543325 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Checking router: 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:23.543686 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Updating router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 port d65653f6-11ec-4231-a8a2-0a1f72ba1870 binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 15:00:23.585674 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:23.672563 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:23.721717 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:23.774385 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:23.780256 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Pushing event updated for resources: {'Port': ['ID=41ed57ec-72c3-4a85-9fb7-dccd23c0a16c,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:23.782830 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:23.787147 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:23.852820 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:23.966256 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:23.979617 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.061004 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Attempting to bind port d65653f6-11ec-4231-a8a2-0a1f72ba1870 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:24.061377 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Attempting to bind port d65653f6-11ec-4231-a8a2-0a1f72ba1870 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:24.061743 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Attempting to bind port d65653f6-11ec-4231-a8a2-0a1f72ba1870 on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:24.070189 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 14, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:24.070490 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:24.070898 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.071297 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:24.071792 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Bound port: d65653f6-11ec-4231-a8a2-0a1f72ba1870, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:24.072222 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.108694 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.128151 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014fe9f4-0dec-47a6-879c-2fee573e3dad None None] Pushing event updated for resources: {'Port': ['ID=d65653f6-11ec-4231-a8a2-0a1f72ba1870,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:24.149495 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-3ebf8e3c-e436-4e67-ab38-cb2bf2a7572f None None] Provisioning complete for port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:24.149966 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3ebf8e3c-e436-4e67-ab38-cb2bf2a7572f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.181582 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5977186c-54ca-4303-8e07-2ca3ac350979 req-11ca3b9a-6d52-45e9-b8dd-debc9bb46974 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:24.183144 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5977186c-54ca-4303-8e07-2ca3ac350979 req-11ca3b9a-6d52-45e9-b8dd-debc9bb46974 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 931 time: 0.0737309 Nov 12 15:00:24.206167 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] For port d65653f6-11ec-4231-a8a2-0a1f72ba1870, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:24.210419 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] For port d65653f6-11ec-4231-a8a2-0a1f72ba1870, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=d65653f6-11ec-4231-a8a2-0a1f72ba1870,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:24.211686 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-3ebf8e3c-e436-4e67-ab38-cb2bf2a7572f None None] Port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:24.217508 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.248156 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5977186c-54ca-4303-8e07-2ca3ac350979 req-766e6eee-5563-429e-9bc7-244cf2fedf0c tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574963 Nov 12 15:00:24.300325 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:24.301171 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T14:59:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:24.362400 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014fe9f4-0dec-47a6-879c-2fee573e3dad None None] Pushing event updated for resources: {'Port': ['ID=d65653f6-11ec-4231-a8a2-0a1f72ba1870,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:24.416322 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.427607 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.457842 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:24.525950 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d5069be0-c752-4859-8481-63f0ce9c7a41 req-38a31f19-d5f6-4640-a61a-770ea0261998 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0686619 Nov 12 15:00:24.538026 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.611587 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2f7fb4c8-0229-4288-9e29-62d0c00075f3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:24.638299 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76421f94-5df6-4b52-93b5-e11cad409590 req-ba333f34-17b9-48bc-b521-50b34b0a782d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:24.647370 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-76421f94-5df6-4b52-93b5-e11cad409590 req-ba333f34-17b9-48bc-b521-50b34b0a782d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 931 time: 0.0769036 Nov 12 15:00:24.654541 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Pushing event updated for resources: {'Port': ['ID=41ed57ec-72c3-4a85-9fb7-dccd23c0a16c,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:24.665151 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:24.666714 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:24.718118 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-76421f94-5df6-4b52-93b5-e11cad409590 req-81bd211d-2cad-4d0d-b50f-6641c42d4eaa tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0684328 Nov 12 15:00:24.845049 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:00:24.891996 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:23Z', 'revision_number': 1, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:24.964909 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c971f9a-661a-47c4-b37b-84ea45832fe3 None None] The sync data for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi is: [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:23Z', 'revision_number': 1, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:25.000473 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:25.012400 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-95ffaa98-e561-4c52-8fd4-51f0f0bf96bb admin admin] 10.222.0.61 "PUT /v2.0/routers/53ca2130-36ca-4c05-9d6e-aa26fcf314f9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4806645 Nov 12 15:00:25.045626 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-8b1dbb71-bad0-4b72-811b-a697075525d3 None None] Provisioning complete for port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:25.046334 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8b1dbb71-bad0-4b72-811b-a697075525d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:25.100286 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-8b1dbb71-bad0-4b72-811b-a697075525d3 None None] Port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:25.379458 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-523de782-7ee7-4790-bec6-ebb064831ff2 req-b6607eab-78a4-4ad7-92e1-2f45900bfe16 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:25.381711 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-523de782-7ee7-4790-bec6-ebb064831ff2 req-b6607eab-78a4-4ad7-92e1-2f45900bfe16 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 931 time: 0.0536520 Nov 12 15:00:25.436351 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-523de782-7ee7-4790-bec6-ebb064831ff2 req-9f925bf8-bf1d-49e2-b0c2-b78822ef5eda tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447822 Nov 12 15:00:25.543645 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:25.589349 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60404) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:25.594476 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-460788527-network', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:25.627627 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Made reservation on behalf of 09abb93cb62345ad88b8e5437b4be1a2 for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:00:25.631072 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:25.636861 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5e3a4e1f-db3c-4420-bce5-55189b4bf605 req-56b87bf8-9736-4ee7-8606-01e75c293c56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=82360b9e-d05e-4010-8b74-d862c5e66562 HTTP/1.1" status: 200 len: 210 time: 0.0283971 Nov 12 15:00:25.640737 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:25.789928 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:25.809872 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:25.915838 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7011e9a6-f233-47c6-881d-2853ed2e63be,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:25.935260 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 643} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 15:00:25.950533 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:25.950863 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Added segment 6b7c6928-b12a-4c48-a905-46863b8c9b31 of type vlan for network 9ea4059b-341e-435e-a2c5-0eadc56bb957 Nov 12 15:00:25.976607 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c40d614-960f-4ea7-a142-9dbd108b7f24 req-b32ac3d2-d29c-41d7-8520-799b2e8c7fa0 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:25.978168 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c40d614-960f-4ea7-a142-9dbd108b7f24 req-b32ac3d2-d29c-41d7-8520-799b2e8c7fa0 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 931 time: 0.1633334 Nov 12 15:00:25.984332 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Request body: {'port': {'device_id': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:26.020767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Request body: {'port': {'device_id': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:26.121153 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.168480 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.181736 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c40d614-960f-4ea7-a142-9dbd108b7f24 req-0448a67d-bc4d-470a-b043-38ad77d24a3f tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1913195 Nov 12 15:00:26.200993 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.220163 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.221101 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:26.221685 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.347276 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7566566 Nov 12 15:00:26.349946 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60412) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:26.354758 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Request body: {'subnet': {'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-460788527-subnet', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'ip_version': 4}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:26.376864 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Made reservation on behalf of 09abb93cb62345ad88b8e5437b4be1a2 for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:00:26.379415 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5175757'] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.425847 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708fb6e9-151f-484c-98a1-a5551dc01ca7 admin admin] Pushing event updated for resources: {'Network': ['ID=9ea4059b-341e-435e-a2c5-0eadc56bb957,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:26.438493 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 9ea4059b-341e-435e-a2c5-0eadc56bb957 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 15:00:26.615984 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a67d755-c1aa-4026-b2d3-346a79278c81 req-8a5081d5-4cdf-46af-926e-194735505c57 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:26.617484 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6a67d755-c1aa-4026-b2d3-346a79278c81 req-8a5081d5-4cdf-46af-926e-194735505c57 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 931 time: 0.0962353 Nov 12 15:00:26.618806 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7428832', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5175775'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.725783 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Pushing event updated for resources: {'Subnet': ['ID=349dd9b2-ae54-4bac-b2af-edcb3af1d07c,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:26.729854 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Checking segment: {'id': '6b7c6928-b12a-4c48-a905-46863b8c9b31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:26.730444 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Network hostable DHCP agents. Network: 9ea4059b-341e-435e-a2c5-0eadc56bb957, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 15:00:26.746553 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6a67d755-c1aa-4026-b2d3-346a79278c81 req-052f15af-7b58-4ef0-bd97-5c4406f06314 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1037390 Nov 12 15:00:26.769848 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60420) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:26.772909 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Network 9ea4059b-341e-435e-a2c5-0eadc56bb957 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 15:00:26.777337 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dd7d017f-a94d-4100-a980-fc29d066f333 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:00:26.788171 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.792349 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 9ea4059b-341e-435e-a2c5-0eadc56bb957) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:26.804648 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 37ce8a4b-01d0-4c8c-8665-8f6627848b39 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:00:26.805126 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:26.805318 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.822297 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a14ab882-978d-43f3-9788-915ec194c77a None None] Network 9ea4059b-341e-435e-a2c5-0eadc56bb957 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:00:26.825725 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.829437 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Transition to ACTIVE for port object dd7d017f-a94d-4100-a980-fc29d066f333 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:00:26.841710 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-61191c3c-7437-4036-b445-6e82a61d7d0b admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4906397 Nov 12 15:00:26.842453 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60422) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:26.858932 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:26.862222 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-95532690-ac22-44a2-9da7-1cc08e629694 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.869390 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.915258 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-95532690-ac22-44a2-9da7-1cc08e629694 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.933874 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Pushing event updated for resources: {'Port': ['ID=dd7d017f-a94d-4100-a980-fc29d066f333,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:26.938328 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Transition to ACTIVE for port object 37ce8a4b-01d0-4c8c-8665-8f6627848b39 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:00:26.950548 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:26.954543 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device d65653f6-11ec-4231-a8a2-0a1f72ba1870 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:27.006312 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.007355 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.007751 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.019495 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-95532690-ac22-44a2-9da7-1cc08e629694 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.028580 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-95532690-ac22-44a2-9da7-1cc08e629694 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.032235 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-95532690-ac22-44a2-9da7-1cc08e629694 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "DELETE /v2.0/security-groups/35291230-5c54-46fa-a3c4-6ead2197bb81 HTTP/1.1" status: 204 len: 168 time: 0.2594495 Nov 12 15:00:27.045707 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60424) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:27.072531 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95532690-ac22-44a2-9da7-1cc08e629694 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=35291230-5c54-46fa-a3c4-6ead2197bb81,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:27.079894 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port d65653f6-11ec-4231-a8a2-0a1f72ba1870 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:27.080390 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.084216 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.api.v2.resource [None req-dff2a2c7-238f-4571-afa2-125ecd7fb4ac tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] show failed (client error): The resource could not be found. Nov 12 15:00:27.085627 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-dff2a2c7-238f-4571-afa2-125ecd7fb4ac tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups/35291230-5c54-46fa-a3c4-6ead2197bb81 HTTP/1.1" status: 404 len: 347 time: 0.0372438 Nov 12 15:00:27.088351 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60426) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:27.150526 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-9ea4059b-341e-435e-a2c5-0eadc56bb957', 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'fixed_ips': [{'subnet_id': '349dd9b2-ae54-4bac-b2af-edcb3af1d07c'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 15:00:27.154217 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.405660 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88138cf-7f46-4ebb-8f62-9ce029117f42 req-2edb77e7-05fa-4c06-98b5-b3fa445703aa tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:27.407299 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f88138cf-7f46-4ebb-8f62-9ce029117f42 req-2edb77e7-05fa-4c06-98b5-b3fa445703aa tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 943 time: 0.0805101 Nov 12 15:00:27.414187 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Deleting port bb414147-ff56-447b-9c91-0bce695f060e {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:00:27.414532 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.437734 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.478194 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Sync routers for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:27.489792 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:27.490441 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:27.532898 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.533752 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.550126 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Calling delete_port for bb414147-ff56-447b-9c91-0bce695f060e owned by network:floatingip {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:00:27.561743 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.583335 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port d65653f6-11ec-4231-a8a2-0a1f72ba1870, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=d65653f6-11ec-4231-a8a2-0a1f72ba1870,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:27.584943 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Pushing event updated for resources: {'Port': ['ID=37ce8a4b-01d0-4c8c-8665-8f6627848b39,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:27.590882 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.597850 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Attempting to bind port dd7d017f-a94d-4100-a980-fc29d066f333 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:27.598183 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Attempting to bind port dd7d017f-a94d-4100-a980-fc29d066f333 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:27.598547 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Attempting to bind port dd7d017f-a94d-4100-a980-fc29d066f333 on network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:27.616999 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Port dd7d017f-a94d-4100-a980-fc29d066f333 on network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:00:27.617333 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Attempting to bind port dd7d017f-a94d-4100-a980-fc29d066f333 on network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:27.628722 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:27.636518 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Allocated IP 172.20.0.2 (9ea4059b-341e-435e-a2c5-0eadc56bb957/349dd9b2-ae54-4bac-b2af-edcb3af1d07c/f686347d-be75-499a-a04e-381fbb6bae13) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:27.666072 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=d65653f6-11ec-4231-a8a2-0a1f72ba1870,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:27.679186 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 0, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:27.679533 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Checking segment: {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:27.680141 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Bound using segment: {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:27.680457 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Bound port: dd7d017f-a94d-4100-a980-fc29d066f333, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5f55f816-14d6-46e6-8ced-6c264b88865e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 642, 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:27.680690 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.705558 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.706011 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.706416 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.706911 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.707291 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.708226 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.708633 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.709057 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.709553 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.710014 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.710403 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.710783 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:27.756150 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.778279 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.824806 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Attempting to bind port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:27.825414 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Attempting to bind port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:27.825414 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Attempting to bind port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 on network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:27.837614 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] For port dd7d017f-a94d-4100-a980-fc29d066f333, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:27.842127 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event deleted for resources: {'Port': ['ID=bb414147-ff56-447b-9c91-0bce695f060e,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:27.842385 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] For port dd7d017f-a94d-4100-a980-fc29d066f333, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=dd7d017f-a94d-4100-a980-fc29d066f333,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:27.844766 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 on network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:00:27.844856 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Attempting to bind port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 on network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:27.869297 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 0, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:27.869626 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Checking segment: {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:27.870001 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Bound using segment: {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:27.870433 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Bound port: 37ce8a4b-01d0-4c8c-8665-8f6627848b39, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7219405f-f48a-498b-8c75-af2c335a831e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:27.870780 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.875297 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.896992 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f88138cf-7f46-4ebb-8f62-9ce029117f42 req-46e92c4a-72c0-45d2-968b-d58d46e5ab02 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4723420 Nov 12 15:00:27.913998 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 2, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:27.923096 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.928392 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.932595 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.948818 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Checking router: 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:27.949311 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Updating router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 15:00:27.965589 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.968952 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.970200 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-80b9f978-c328-4da0-b6d4-9513c0fc80ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "DELETE /v2.0/floatingips/f9a56ed8-901e-4103-8243-d3099350c0b2 HTTP/1.1" status: 204 len: 168 time: 0.8806913 Nov 12 15:00:27.978735 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:27.988804 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Pushing event updated for resources: {'Port': ['ID=f686347d-be75-499a-a04e-381fbb6bae13,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:28.008542 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Network 9ea4059b-341e-435e-a2c5-0eadc56bb957 is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:28.010642 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:28.018283 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Pushing event updated for resources: {'Port': ['ID=dd7d017f-a94d-4100-a980-fc29d066f333,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:28.040299 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:28.071965 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:28.072717 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.074093 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-79b4fa5c-0a48-44b5-a57c-a3c83e50dce2 service neutron] 10.222.0.86 "PUT /v2.0/ports/dd7d017f-a94d-4100-a980-fc29d066f333 HTTP/1.1" status: 200 len: 1093 time: 2.3010242 Nov 12 15:00:28.094360 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'tag': 'dd7d017f-a94d-4100-a980-fc29d066f333'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:28.097654 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf9ae2d8-6b24-44df-8031-dee1d6880018" -d '{"events": [{"name": "network-changed", "server_uuid": "4890b09a-fc1a-4d2a-89bf-35b5c775d762", "tag": "dd7d017f-a94d-4100-a980-fc29d066f333"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:28.121242 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Attempting to bind port f686347d-be75-499a-a04e-381fbb6bae13 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:28.121883 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Attempting to bind port f686347d-be75-499a-a04e-381fbb6bae13 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '6b7c6928-b12a-4c48-a905-46863b8c9b31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:28.122303 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Attempting to bind port f686347d-be75-499a-a04e-381fbb6bae13 on network 9ea4059b-341e-435e-a2c5-0eadc56bb957 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:28.128810 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:28.129185 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Checking segment: {'id': '6b7c6928-b12a-4c48-a905-46863b8c9b31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:28.130278 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.130833 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Bound using segment: {'id': '6b7c6928-b12a-4c48-a905-46863b8c9b31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:28.131378 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Bound port: f686347d-be75-499a-a04e-381fbb6bae13, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6b7c6928-b12a-4c48-a905-46863b8c9b31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:28.131812 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.145177 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f574ed1a-c9cf-499d-b52e-c00dd206fa41 req-5d7ff28c-ee91-415a-b2c2-8ad75051aef8 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:28.147286 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f574ed1a-c9cf-499d-b52e-c00dd206fa41 req-5d7ff28c-ee91-415a-b2c2-8ad75051aef8 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 943 time: 0.2801940 Nov 12 15:00:28.221529 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] For port 37ce8a4b-01d0-4c8c-8665-8f6627848b39, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:28.232790 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] For port f686347d-be75-499a-a04e-381fbb6bae13, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:28.238225 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] For port f686347d-be75-499a-a04e-381fbb6bae13, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=f686347d-be75-499a-a04e-381fbb6bae13,segment=NetworkSegment(6b7c6928-b12a-4c48-a905-46863b8c9b31),segment_id=6b7c6928-b12a-4c48-a905-46863b8c9b31)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:28.249471 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.276498 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] For port 37ce8a4b-01d0-4c8c-8665-8f6627848b39, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:28.285245 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60436) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:28.291213 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'security_group': {'name': 'tempest-securitygroup--18497229', 'description': 'tempest-description--435362406'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:28.308066 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.328133 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315174f5-1cc3-4ac7-9ae4-f50718eb9a0a None None] Pushing event updated for resources: {'Port': ['ID=f686347d-be75-499a-a04e-381fbb6bae13,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:28.333640 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.364241 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-1ab8e676-ffaa-4eda-95cf-4ad359404e7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:28.366660 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-1ab8e676-ffaa-4eda-95cf-4ad359404e7f service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 1096 time: 0.2499976 Nov 12 15:00:28.406273 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.418446 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.475169 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:28.475786 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.477650 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] 10.222.0.86 "PUT /v2.0/ports/37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 1093 time: 2.7057776 Nov 12 15:00:28.493846 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f574ed1a-c9cf-499d-b52e-c00dd206fa41 req-eb5107d1-f2a2-4c03-a44d-bd19cc2b0256 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3313866 Nov 12 15:00:28.501576 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-1440ae01-2129-41fa-8e00-0e203fd2e59a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd7d017f-a94d-4100-a980-fc29d066f333 HTTP/1.1" status: 200 len: 217 time: 0.0882580 Nov 12 15:00:28.506018 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5528754-1283-4261-a0f8-6a71ad2b879f None None] Pushing event updated for resources: {'Port': ['ID=41ed57ec-72c3-4a85-9fb7-dccd23c0a16c,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:28.548676 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.558349 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.606748 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Attempting to bind port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:28.606972 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Attempting to bind port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:28.609048 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Attempting to bind port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c on network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:28.616350 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.617866 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3307674 Nov 12 15:00:28.618387 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:28.618938 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Checking segment: {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:28.619403 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.619853 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Bound using segment: {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:28.620500 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Bound port: 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:28.621029 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.622178 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60440) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:28.631027 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-193b6442-2e8d-4fb7-baaa-9655ae9b6695 service neutron] Pushing event updated for resources: {'Port': ['ID=37ce8a4b-01d0-4c8c-8665-8f6627848b39,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:28.637067 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-b9869ebb-2a39-480e-949a-d095a0aeac18 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'security_group_rule': {'security_group_id': 'c2a69211-0102-4e9e-9e2f-4bbab81afda5', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:28.684148 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b9869ebb-2a39-480e-949a-d095a0aeac18 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.685215 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23f9472b-0b49-49dd-8c51-150bb80c8c03 x-openstack-request-id: req-23f9472b-0b49-49dd-8c51-150bb80c8c03 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:28.685690 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4890b09a-fc1a-4d2a-89bf-35b5c775d762", "tag": "dd7d017f-a94d-4100-a980-fc29d066f333", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:28.686091 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-23f9472b-0b49-49dd-8c51-150bb80c8c03 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:28.686803 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'tag': 'dd7d017f-a94d-4100-a980-fc29d066f333', 'status': 'completed', 'code': 200} Nov 12 15:00:28.708083 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] For port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:28.714134 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] For port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=41ed57ec-72c3-4a85-9fb7-dccd23c0a16c,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:28.720035 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.749721 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c2a69211-0102-4e9e-9e2f-4bbab81afda5,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:28.768530 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b9869ebb-2a39-480e-949a-d095a0aeac18 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.795322 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.795910 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.795997 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.796359 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.796693 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.798591 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.798953 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.799294 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.799629 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.799973 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.800509 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.800840 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-380cad2c-4a10-48f3-a192-e3c222589062 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:00:28.804647 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b9869ebb-2a39-480e-949a-d095a0aeac18 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.818874 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9869ebb-2a39-480e-949a-d095a0aeac18 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5c0f3a73-b2a4-4e27-a089-db119cf09921,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:28.845279 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b9869ebb-2a39-480e-949a-d095a0aeac18 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:28.846569 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-b9869ebb-2a39-480e-949a-d095a0aeac18 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2231374 Nov 12 15:00:28.851270 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5528754-1283-4261-a0f8-6a71ad2b879f None None] Pushing event updated for resources: {'Port': ['ID=41ed57ec-72c3-4a85-9fb7-dccd23c0a16c,revision_number=4']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:28.853244 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60442) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:28.872707 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-f31ac65b-293a-4879-9892-6324d902773c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'security_group_rule': {'security_group_id': 'c2a69211-0102-4e9e-9e2f-4bbab81afda5', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:28.875462 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:28.876129 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:28.886176 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-73d86a2a-dbf5-4d55-b6f5-8f91484ceeb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:28.887892 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-73d86a2a-dbf5-4d55-b6f5-8f91484ceeb5 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1096 time: 0.3215139 Nov 12 15:00:28.914919 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-2481ae65-055c-42e2-ab74-533ce1faea4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:28.916385 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-2481ae65-055c-42e2-ab74-533ce1faea4f service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 200 len: 850 time: 0.3543296 Nov 12 15:00:29.020021 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-4928ee8b-783b-4764-82f1-eacf7214bbab service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 217 time: 0.1186843 Nov 12 15:00:29.022948 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.057606 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:29.104234 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device f686347d-be75-499a-a04e-381fbb6bae13 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:29.113748 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.179659 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-f9024bc3-9b97-4016-9a27-00791dfb50e1 None None] Provisioning complete for port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:29.180587 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f9024bc3-9b97-4016-9a27-00791dfb50e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.181711 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-c985f490-872f-4af5-9c1d-d52a999b821c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:29.183227 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-c985f490-872f-4af5-9c1d-d52a999b821c service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2547240 Nov 12 15:00:29.184728 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f31ac65b-293a-4879-9892-6324d902773c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.225432 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port f686347d-be75-499a-a04e-381fbb6bae13 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:29.225432 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.306964 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-e3a677ff-849d-43b6-a849-c2cde0e7adec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:29.309236 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-e3a677ff-849d-43b6-a849-c2cde0e7adec service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 HTTP/1.1" status: 200 len: 853 time: 0.2334521 Nov 12 15:00:29.327189 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e6a625-1038-4b94-8eed-4fff39d73126 req-8b80587e-4f6c-49a7-b786-3ff010a439c7 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:29.328627 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-19e6a625-1038-4b94-8eed-4fff39d73126 req-8b80587e-4f6c-49a7-b786-3ff010a439c7 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 943 time: 0.2748084 Nov 12 15:00:29.328750 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:28Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:29.333039 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f9024bc3-9b97-4016-9a27-00791dfb50e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.394983 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.400717 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-f9024bc3-9b97-4016-9a27-00791dfb50e1 None None] For port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=41ed57ec-72c3-4a85-9fb7-dccd23c0a16c,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:29.421961 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f9024bc3-9b97-4016-9a27-00791dfb50e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.475069 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba27538a-81b4-42b8-a37e-60d691e85782 None None] The sync data for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi is: [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:28Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:29.503888 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9024bc3-9b97-4016-9a27-00791dfb50e1 None None] Pushing event updated for resources: {'Port': ['ID=41ed57ec-72c3-4a85-9fb7-dccd23c0a16c,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:29.505215 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f31ac65b-293a-4879-9892-6324d902773c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.516934 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port f686347d-be75-499a-a04e-381fbb6bae13, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=f686347d-be75-499a-a04e-381fbb6bae13,segment=NetworkSegment(6b7c6928-b12a-4c48-a905-46863b8c9b31),segment_id=6b7c6928-b12a-4c48-a905-46863b8c9b31)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:29.521120 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.522368 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device d65653f6-11ec-4231-a8a2-0a1f72ba1870 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:29.531719 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f31ac65b-293a-4879-9892-6324d902773c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.571814 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-e6c27ad1-2f21-4e3b-8b66-b8868ce0719f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:29.573483 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-e6c27ad1-2f21-4e3b-8b66-b8868ce0719f service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2543142 Nov 12 15:00:29.575432 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-fd9b82b7-91a1-4442-a71f-99fc74a298a2 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3761637 Nov 12 15:00:29.593175 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-19e6a625-1038-4b94-8eed-4fff39d73126 req-dd8fab97-b10d-4731-b4bd-e6470948ca6d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2195685 Nov 12 15:00:29.603327 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Allocated IP 172.27.3.214 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/a37e6d6f-dfbc-497d-8a9f-aaacf5a15571) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:29.606058 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31ac65b-293a-4879-9892-6324d902773c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2e6eecab-21ae-42bb-a3e8-b423fd640bab,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:29.616486 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-9659f5a9-3924-4ddd-b013-abe09e07ba04 None None] Provisioning complete for port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:29.616860 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-9659f5a9-3924-4ddd-b013-abe09e07ba04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.643890 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f31ac65b-293a-4879-9892-6324d902773c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.645478 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f31ac65b-293a-4879-9892-6324d902773c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7895799 Nov 12 15:00:29.671111 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60448) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:29.672814 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=f686347d-be75-499a-a04e-381fbb6bae13,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:29.678770 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'floatingip': {'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:29.705993 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.714490 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port d65653f6-11ec-4231-a8a2-0a1f72ba1870 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:29.714854 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.811539 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d10bbfb2-1d91-4128-9ca5-2a8f91c22552 req-4cd3d7e2-9ee5-4721-bc65-a300058c139d service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2171419 Nov 12 15:00:29.814706 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a773e2-a5f6-438a-87a2-c14d0eaa9b4b req-ce4ab9dd-7222-40da-ac07-b6aa7d2db367 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:29.828585 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-04a773e2-a5f6-438a-87a2-c14d0eaa9b4b req-ce4ab9dd-7222-40da-ac07-b6aa7d2db367 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 943 time: 0.2062893 Nov 12 15:00:29.897159 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-04a773e2-a5f6-438a-87a2-c14d0eaa9b4b req-b4001359-c198-46a9-b629-2fc431970997 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537348 Nov 12 15:00:29.910072 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-b56b91ca-4510-45d1-8ca0-42ad86c47453 service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3146608 Nov 12 15:00:29.945790 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:29.965633 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f149c133-b9bf-4e9c-a374-6ff8fc40a1b3 None None] Network 9ea4059b-341e-435e-a2c5-0eadc56bb957 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:00:30.050540 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-84a7b215-2d62-4352-a1b2-257014dfe538 None None] Provisioning complete for port f686347d-be75-499a-a04e-381fbb6bae13 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:30.051305 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-84a7b215-2d62-4352-a1b2-257014dfe538 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:30.101125 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-f469a4e9-953c-492a-9daa-0463eb4d39db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:30.102652 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-f469a4e9-953c-492a-9daa-0463eb4d39db service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 1096 time: 0.1906116 Nov 12 15:00:30.201737 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3e4bbb-00a0-4618-92d3-1566756f8d79 req-99f2b2a0-7707-4beb-be66-2c4bc53cc809 service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2739246 Nov 12 15:00:30.206371 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:30.257968 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-312b15c4-2908-4948-97bb-7c111dbd0682 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:30.259428 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-312b15c4-2908-4948-97bb-7c111dbd0682 service neutron] 10.222.0.86 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 912 time: 0.1431658 Nov 12 15:00:30.277496 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:30.325341 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-8911979e-740a-42da-a0c9-0f5deea6a1c6 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd7d017f-a94d-4100-a980-fc29d066f333 HTTP/1.1" status: 200 len: 217 time: 0.0568359 Nov 12 15:00:30.332032 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Allocated IP 172.27.3.70 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/e321ef24-f0ee-4d80-9313-d68dd3738ba3) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:30.394443 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:30.400709 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:30.403740 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:30.413002 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Pushing event updated for resources: {'Port': ['ID=a37e6d6f-dfbc-497d-8a9f-aaacf5a15571,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:30.447772 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-5499092f-5838-49ee-9607-9a511d44b898 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:30.449354 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-5499092f-5838-49ee-9607-9a511d44b898 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 200 len: 850 time: 0.1033330 Nov 12 15:00:30.467188 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:30.515472 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:30.526196 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-82393611-34ba-46e5-858e-c9a6c82eaece None None] Provisioning complete for port f686347d-be75-499a-a04e-381fbb6bae13 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:30.526765 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-82393611-34ba-46e5-858e-c9a6c82eaece None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:30.555313 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:30.558247 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:30.560781 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:30.581673 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-2bf7448e-54fd-4e05-adb2-bd7152ef0517 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:30.583333 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-2bf7448e-54fd-4e05-adb2-bd7152ef0517 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1258707 Nov 12 15:00:30.601991 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'Port': ['ID=e321ef24-f0ee-4d80-9313-d68dd3738ba3,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:30.709199 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:30.868543 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:30.881055 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:30.883629 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-465ba99a-e9ae-48bc-a296-d452860fa37b" -d '{"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:30.952044 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:30.954453 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:30.961934 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c23dfb2-da51-4ef9-ad09-7ab2cd1caef0 x-openstack-request-id: req-5c23dfb2-da51-4ef9-ad09-7ab2cd1caef0 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:30.962469 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:30.962469 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-5c23dfb2-da51-4ef9-ad09-7ab2cd1caef0 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:30.962853 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'status': 'completed', 'code': 200} Nov 12 15:00:30.999241 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:31.068635 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device f686347d-be75-499a-a04e-381fbb6bae13 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:31.079905 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab38753-f0fd-4206-8217-be540d2b39d0 req-608e5f82-b4ee-404c-ad39-ad9d8d56250c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:31.081434 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cab38753-f0fd-4206-8217-be540d2b39d0 req-608e5f82-b4ee-404c-ad39-ad9d8d56250c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 943 time: 0.1948864 Nov 12 15:00:31.087785 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-6b868b0e-9cd5-48f7-a6fd-4ced53786368 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4875154 Nov 12 15:00:31.113394 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b13f56-7bcd-44fb-b5e7-44184a24af48 req-aaa448c8-8988-46c8-a3e0-2141b22940cc tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:31.119959 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port f686347d-be75-499a-a04e-381fbb6bae13 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:31.120366 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:31.122094 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-94b13f56-7bcd-44fb-b5e7-44184a24af48 req-aaa448c8-8988-46c8-a3e0-2141b22940cc tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 943 time: 0.1011243 Nov 12 15:00:31.137488 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-9bcf23dd-3bf6-4f0b-bb4a-2d35db15eb8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:31.138989 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-9bcf23dd-3bf6-4f0b-bb4a-2d35db15eb8c service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1096 time: 0.1603291 Nov 12 15:00:31.212257 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-94b13f56-7bcd-44fb-b5e7-44184a24af48 req-b90cf817-bba6-45e7-a74b-aa24aaa908d3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892498 Nov 12 15:00:31.250232 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for port, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:31.256167 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7428717'] for port, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:31.303568 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:31.331753 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'Port': ['ID=e321ef24-f0ee-4d80-9313-d68dd3738ba3,revision_number=2']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:31.341766 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:31.357551 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:31.358863 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-cfae1357-8015-4290-a019-46e742cc008e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.6852219 Nov 12 15:00:31.359749 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cab38753-f0fd-4206-8217-be540d2b39d0 req-33b5ab7d-4802-4d77-a2a6-de66de284eaa tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2709970 Nov 12 15:00:31.377737 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bf9ae2d8-6b24-44df-8031-dee1d6880018 req-a4a0d44b-4fba-404e-88de-8df220ad823c service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2765467 Nov 12 15:00:31.434286 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-9353c87b-aa64-46dd-b838-770cb2ea779c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:31.435765 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-9353c87b-aa64-46dd-b838-770cb2ea779c service neutron] 10.222.0.86 "GET /v2.0/networks?id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 200 len: 915 time: 0.2621276 Nov 12 15:00:31.486918 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-d8f8d573-c4a6-4309-8bc9-9d4cfd1fb0e9 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 217 time: 0.0419230 Nov 12 15:00:31.559909 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-ff454157-d01e-4a11-a2a5-c1a9f83b57c5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-securitygroup--18497229&fields=id&tenant_id=296b2e6385f04550a366eb21cf48ea40 HTTP/1.1" status: 200 len: 267 time: 0.0442452 Nov 12 15:00:31.606574 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-da4cd7c8-dccd-4108-8e07-78a58260c8ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:31.608058 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-da4cd7c8-dccd-4108-8e07-78a58260c8ee service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 HTTP/1.1" status: 200 len: 853 time: 0.0869443 Nov 12 15:00:31.651825 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:31.671658 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-8bb4ea1e-5c6d-4acc-9eb4-481b18f69165 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:31.673212 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-8bb4ea1e-5c6d-4acc-9eb4-481b18f69165 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 817 time: 0.1064718 Nov 12 15:00:31.691335 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-378a606c-70dd-4a97-9c15-386555c2e480 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/quotas/296b2e6385f04550a366eb21cf48ea40 HTTP/1.1" status: 200 len: 375 time: 0.0094893 Nov 12 15:00:31.703645 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-2ee60ea1-2dc7-419d-9c04-bcf15979d541 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:31.705150 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-2ee60ea1-2dc7-419d-9c04-bcf15979d541 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0875771 Nov 12 15:00:31.749022 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-04545865-a333-4c02-b0a4-08a65b5fdcde tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0539076 Nov 12 15:00:31.846690 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-49c4780c-f38a-4963-9401-2a589a66fdc7 service neutron] 10.222.0.61 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832355 Nov 12 15:00:31.847873 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-d46f90a0-3f3e-495d-b64d-55e5d10385cb service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1335690 Nov 12 15:00:31.888886 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Router 91c37de3-bf30-4b11-bf97-996a0d1b7691 is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101618) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 15:00:31.940058 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-e7024f63-7fe2-40e2-9b95-ec5b6d8e9f3b service neutron] 10.222.0.61 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871100 Nov 12 15:00:32.021047 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-465ba99a-e9ae-48bc-a296-d452860fa37b req-beef0049-c699-4aaa-be5d-fb9ab3c6ec7f service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1654732 Nov 12 15:00:32.047888 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:32.065006 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Sync routers for ids ['91c37de3-bf30-4b11-bf97-996a0d1b7691'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:32.071058 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:32.074461 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-edae76cc-b1ea-4525-a6ed-79c6247ca4ff admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 5.2236497 Nov 12 15:00:32.075374 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60472) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:32.078016 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Routers {'91c37de3-bf30-4b11-bf97-996a0d1b7691'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:32.078793 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['91c37de3-bf30-4b11-bf97-996a0d1b7691'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:32.149853 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1f587c25-383a-41d3-bf45-176e0f22e417 req-16dc0855-13f1-4565-9148-c9b4e5bab018 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 210 time: 0.0325832 Nov 12 15:00:32.195124 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Set router 91c37de3-bf30-4b11-bf97-996a0d1b7691 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:32.373194 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bfb9ebc-ebfa-4ca7-a953-fffe103a529f req-9f82c03f-70b7-49be-bad1-d7b287b2fd49 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:32.382069 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5bfb9ebc-ebfa-4ca7-a953-fffe103a529f req-9f82c03f-70b7-49be-bad1-d7b287b2fd49 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 943 time: 0.0652502 Nov 12 15:00:32.388594 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214'}], 'enable_snat': True}, 'gw_port_id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:27Z', 'updated_at': '2021-11-12T15:00:30Z', 'revision_number': 3, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'gw_port': {'id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:9f:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:29Z', 'updated_at': '2021-11-12T15:00:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:32.419784 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device dd7d017f-a94d-4100-a980-fc29d066f333 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:00:32.439268 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Checking router: 91c37de3-bf30-4b11-bf97-996a0d1b7691 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:32.439654 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Updating router 91c37de3-bf30-4b11-bf97-996a0d1b7691 port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 15:00:32.474514 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5bfb9ebc-ebfa-4ca7-a953-fffe103a529f req-47b68633-fa0d-43fe-a729-a0e1ee3fe16f tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912194 Nov 12 15:00:32.489777 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:32.541878 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa5e625f-f19e-42e1-a39a-0d0e95c98fd4 req-3dcfe334-221c-4f30-82df-00e9876aa769 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:32.544335 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa5e625f-f19e-42e1-a39a-0d0e95c98fd4 req-3dcfe334-221c-4f30-82df-00e9876aa769 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 943 time: 0.0846989 Nov 12 15:00:32.657180 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa5e625f-f19e-42e1-a39a-0d0e95c98fd4 req-798ca7f5-5ba9-4f82-a86f-f1fd8e15e261 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0825715 Nov 12 15:00:32.719841 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:32.769399 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port dd7d017f-a94d-4100-a980-fc29d066f333, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=dd7d017f-a94d-4100-a980-fc29d066f333,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:32.795778 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'dd7d017f-a94d-4100-a980-fc29d066f333', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'port_id': 'dd7d017f-a94d-4100-a980-fc29d066f333', 'mac_address': 'fa:16:3e:f3:7e:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 642, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:00:32.879481 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:32.901225 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Allocated IP 172.20.0.1 (9ea4059b-341e-435e-a2c5-0eadc56bb957/349dd9b2-ae54-4bac-b2af-edcb3af1d07c/cd8e036b-d217-4fa6-940d-9fc14004e5e6) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:32.912924 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dd7d017f-a94d-4100-a980-fc29d066f333 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:00:32.943910 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port dd7d017f-a94d-4100-a980-fc29d066f333, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=dd7d017f-a94d-4100-a980-fc29d066f333,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:32.948451 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:32.949103 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 37ce8a4b-01d0-4c8c-8665-8f6627848b39 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:00:33.007858 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.064654 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=dd7d017f-a94d-4100-a980-fc29d066f333,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:33.070572 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.103230 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.182085 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 37ce8a4b-01d0-4c8c-8665-8f6627848b39, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:33.185273 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Attempting to bind port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:33.185581 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Attempting to bind port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:33.185947 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Attempting to bind port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:33.194143 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9302fd44-638d-4117-9a05-fea4e8ebc648 None None] Pushing event updated for resources: {'Port': ['ID=a37e6d6f-dfbc-497d-8a9f-aaacf5a15571,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:33.203927 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'port_id': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'mac_address': 'fa:16:3e:f2:ce:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 614, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:00:33.207137 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:33.207986 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:33.208437 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.208830 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:33.209313 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Bound port: a37e6d6f-dfbc-497d-8a9f-aaacf5a15571, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:33.209689 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.286759 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-34d5ecfa-3a74-447e-a96a-c82eac523f13 req-3178b4a0-3b5d-422c-9372-86d0aac60f0d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 210 time: 0.0283558 Nov 12 15:00:33.295208 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.309784 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] For port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:33.320400 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 37ce8a4b-01d0-4c8c-8665-8f6627848b39 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:00:33.328539 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] For port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=a37e6d6f-dfbc-497d-8a9f-aaacf5a15571,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:33.338089 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.351624 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 37ce8a4b-01d0-4c8c-8665-8f6627848b39, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:33.361370 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.375777 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.405600 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Routers {'91c37de3-bf30-4b11-bf97-996a0d1b7691'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:33.406229 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['91c37de3-bf30-4b11-bf97-996a0d1b7691'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:33.411017 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9302fd44-638d-4117-9a05-fea4e8ebc648 None None] Pushing event updated for resources: {'Port': ['ID=a37e6d6f-dfbc-497d-8a9f-aaacf5a15571,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:33.418492 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Network 9ea4059b-341e-435e-a2c5-0eadc56bb957 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:33.428623 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:33.431565 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:33.469405 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Pushing event updated for resources: {'Port': ['ID=cd8e036b-d217-4fa6-940d-9fc14004e5e6,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:33.489734 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-08d99bb6-90ec-499a-a3d1-c0994bceb6e0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:33.491951 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-08d99bb6-90ec-499a-a3d1-c0994bceb6e0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 817 time: 0.4575391 Nov 12 15:00:33.499098 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.547832 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=37ce8a4b-01d0-4c8c-8665-8f6627848b39,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:33.576949 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] Set router 91c37de3-bf30-4b11-bf97-996a0d1b7691 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:33.636508 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['37ce8a4b-01d0-4c8c-8665-8f6627848b39'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:00:33.641622 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['dd7d017f-a94d-4100-a980-fc29d066f333'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:00:33.681965 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-177f676b-38cb-4231-809b-eed0cb1a35e4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=296b2e6385f04550a366eb21cf48ea40 HTTP/1.1" status: 200 len: 378 time: 0.1798646 Nov 12 15:00:33.697126 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'port': {'device_id': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'admin_state_up': True, 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'security_groups': ['c2a69211-0102-4e9e-9e2f-4bbab81afda5']}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:33.707914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2e0d5e-c10e-4327-9c54-b09d39bccfc0 req-265ebcde-ee47-41a5-9c49-63211c76c240 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:33.709432 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ff2e0d5e-c10e-4327-9c54-b09d39bccfc0 req-265ebcde-ee47-41a5-9c49-63211c76c240 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 944 time: 0.1456013 Nov 12 15:00:33.805850 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e809ce-07c2-4103-8da0-2b7804d422c3 req-29cadaed-5850-4c52-9931-c29f80e7d9d1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:33.809634 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-85e809ce-07c2-4103-8da0-2b7804d422c3 req-29cadaed-5850-4c52-9931-c29f80e7d9d1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 944 time: 0.0655315 Nov 12 15:00:33.815864 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-eeae6440-9f11-423d-b755-9680de1e6113 None None] Provisioning complete for port cd8e036b-d217-4fa6-940d-9fc14004e5e6 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:33.816259 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-eeae6440-9f11-423d-b755-9680de1e6113 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.836870 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:33.866055 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-85e809ce-07c2-4103-8da0-2b7804d422c3 req-e64ae2a1-1c56-4eb1-8ebe-0c6e34987bab tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517526 Nov 12 15:00:33.870674 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ff2e0d5e-c10e-4327-9c54-b09d39bccfc0 req-2a25b896-83e1-4015-a2e4-1c2bfaf031b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1409309 Nov 12 15:00:33.923217 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-eeae6440-9f11-423d-b755-9680de1e6113 None None] Port cd8e036b-d217-4fa6-940d-9fc14004e5e6 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:33.958794 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Made reservation on behalf of 296b2e6385f04550a366eb21cf48ea40 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:00:33.962457 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:34.044552 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214'}], 'enable_snat': True}, 'gw_port_id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:27Z', 'updated_at': '2021-11-12T15:00:30Z', 'revision_number': 3, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'gw_port': {'id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:9f:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:29Z', 'updated_at': '2021-11-12T15:00:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:34.078604 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d524b6e-8f30-4cec-af00-acbf4a194d1a None None] The sync data for ids ['91c37de3-bf30-4b11-bf97-996a0d1b7691'] in dv-cinder-776422-5-iscsi is: [{'id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214'}], 'enable_snat': True}, 'gw_port_id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:27Z', 'updated_at': '2021-11-12T15:00:30Z', 'revision_number': 3, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'gw_port': {'id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:9f:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:29Z', 'updated_at': '2021-11-12T15:00:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:34.171661 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:34.181809 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:34.207272 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Allocated IP 172.20.0.12 (368d9cfc-aec2-497f-8e69-e7fae7839a5a/c422e2f7-99f1-47f1-a8bd-e908500e494f/b0bd777f-598e-4de7-ab20-79ef7b06cdac) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:34.271606 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Pushing event updated for resources: {'Port': ['ID=cd8e036b-d217-4fa6-940d-9fc14004e5e6,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:34.290214 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:34.461077 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-002e1173-cbf6-4679-a7df-2f20e1e58a57 req-db62e055-884c-452f-9936-735210510616 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 210 time: 0.0623677 Nov 12 15:00:34.531554 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:34.539443 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Network 9ea4059b-341e-435e-a2c5-0eadc56bb957 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:34.542231 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:34.654452 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:34.714484 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:34.724388 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:34.728859 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:34.770869 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-486b3e7a-8dc2-4962-8c84-a47e46e0bf19 None None] Provisioning complete for port cd8e036b-d217-4fa6-940d-9fc14004e5e6 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:34.771241 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-486b3e7a-8dc2-4962-8c84-a47e46e0bf19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:34.782540 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:34.792958 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Router 91c37de3-bf30-4b11-bf97-996a0d1b7691 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:00:34.831942 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:34.832767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:34.843414 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-486b3e7a-8dc2-4962-8c84-a47e46e0bf19 None None] Port cd8e036b-d217-4fa6-940d-9fc14004e5e6 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:34.889754 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:34.904494 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-de9d3120-31ff-44e3-9cb5-6c145f3ddf75 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2155974 Nov 12 15:00:34.917645 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Request body: {'port': {'device_id': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:34.986684 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.002166 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:35.002709 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.071130 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.073957 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:35.078839 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-3f36caaa-9b21-4746-a9c6-fda678955650 admin admin] 10.222.0.61 "PUT /v2.0/routers/91c37de3-bf30-4b11-bf97-996a0d1b7691/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0020356 Nov 12 15:00:35.084580 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e53861-8cb3-49ea-a195-b2b8861e3af7 req-9f6b4660-6843-4bf2-a88b-8d9fe02acaeb tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:35.086676 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d9e53861-8cb3-49ea-a195-b2b8861e3af7 req-9f6b4660-6843-4bf2-a88b-8d9fe02acaeb tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 944 time: 0.0786543 Nov 12 15:00:35.106275 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-0b3732d0-e5f0-4d6b-ad10-58994ac6aef4 None None] Provisioning complete for port b0bd777f-598e-4de7-ab20-79ef7b06cdac triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:35.106898 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0b3732d0-e5f0-4d6b-ad10-58994ac6aef4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.131029 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c451c1bc-43cf-4449-9355-7f17e9d922d8 req-dbb08db1-95ca-4e49-be64-ea4ae3dcc309 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:35.142172 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c451c1bc-43cf-4449-9355-7f17e9d922d8 req-dbb08db1-95ca-4e49-be64-ea4ae3dcc309 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 944 time: 0.1193764 Nov 12 15:00:35.143921 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d9e53861-8cb3-49ea-a195-b2b8861e3af7 req-339d5970-93d2-4e03-b8a5-098e5667d5c4 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503917 Nov 12 15:00:35.147959 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.168664 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-0b3732d0-e5f0-4d6b-ad10-58994ac6aef4 None None] Port b0bd777f-598e-4de7-ab20-79ef7b06cdac cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:35.182068 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=a37e6d6f-dfbc-497d-8a9f-aaacf5a15571,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:35.186969 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.245208 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=a37e6d6f-dfbc-497d-8a9f-aaacf5a15571,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:35.340605 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c451c1bc-43cf-4449-9355-7f17e9d922d8 req-ed3b3929-f110-4ef5-8f79-4dc5aefcc7ef tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1977007 Nov 12 15:00:35.440436 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b0bd777f-598e-4de7-ab20-79ef7b06cdac {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:00:35.451306 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.463992 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Transition to ACTIVE for port object b0bd777f-598e-4de7-ab20-79ef7b06cdac will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:00:35.468513 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.537410 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:35.570427 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60510) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:35.574954 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-300922bd-5210-4daf-8e3b-92aafe12ac4c tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-409295797', 'description': 'tempest-secgroup-smoke-409295797 description', 'project_id': '49070bd2a8b542b3801c73a224b4bba5'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:35.598636 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-300922bd-5210-4daf-8e3b-92aafe12ac4c tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.633652 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Attempting to bind port b0bd777f-598e-4de7-ab20-79ef7b06cdac on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:35.634045 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Attempting to bind port b0bd777f-598e-4de7-ab20-79ef7b06cdac by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:35.634376 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Attempting to bind port b0bd777f-598e-4de7-ab20-79ef7b06cdac on network 368d9cfc-aec2-497f-8e69-e7fae7839a5a {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:35.643888 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-149604f5-cf6c-456b-82eb-752a4dcb5cea req-7f87f501-c80f-408d-b97c-eb2dc0dcb1f0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:35.645532 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-149604f5-cf6c-456b-82eb-752a4dcb5cea req-7f87f501-c80f-408d-b97c-eb2dc0dcb1f0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0827115 Nov 12 15:00:35.650227 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Port b0bd777f-598e-4de7-ab20-79ef7b06cdac on network 368d9cfc-aec2-497f-8e69-e7fae7839a5a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:00:35.650555 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Attempting to bind port b0bd777f-598e-4de7-ab20-79ef7b06cdac on network 368d9cfc-aec2-497f-8e69-e7fae7839a5a {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:35.664289 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 0, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:35.664636 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Checking segment: {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:35.665046 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Bound using segment: {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:35.665544 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Bound port: b0bd777f-598e-4de7-ab20-79ef7b06cdac, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd67bfce2-3a19-495f-a2aa-b7d951abcd01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:35.665948 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.671804 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-300922bd-5210-4daf-8e3b-92aafe12ac4c tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.678069 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-300922bd-5210-4daf-8e3b-92aafe12ac4c tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.708679 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-300922bd-5210-4daf-8e3b-92aafe12ac4c tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.709903 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-300922bd-5210-4daf-8e3b-92aafe12ac4c tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1384523 Nov 12 15:00:35.714563 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60512) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:35.718987 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-48e8a0d7-0405-4f66-b600-117e73b0f740 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Request body: {'security_group_rule': {'security_group_id': '708da2d1-4d8f-46ad-af5e-34eafadae301', 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:35.723820 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300922bd-5210-4daf-8e3b-92aafe12ac4c tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'SecurityGroup': ['ID=708da2d1-4d8f-46ad-af5e-34eafadae301,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:35.746264 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-149604f5-cf6c-456b-82eb-752a4dcb5cea req-de698be6-6e47-4e97-ac97-c0d940d00c59 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0909405 Nov 12 15:00:35.763810 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-48e8a0d7-0405-4f66-b600-117e73b0f740 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.777382 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:35.780673 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:35.785385 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.822892 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:35.823606 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.824968 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] 10.222.0.86 "PUT /v2.0/ports/b0bd777f-598e-4de7-ab20-79ef7b06cdac HTTP/1.1" status: 200 len: 1094 time: 0.9120488 Nov 12 15:00:35.825387 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:35.827658 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-04b55036-42db-4444-a817-da35ca0abfd2" -d '{"events": [{"name": "network-changed", "server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:35.847850 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-48e8a0d7-0405-4f66-b600-117e73b0f740 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.853162 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-48e8a0d7-0405-4f66-b600-117e73b0f740 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.857032 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607490a0-07de-42a3-8b9d-999e43604cd0 service neutron] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:35.877890 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48e8a0d7-0405-4f66-b600-117e73b0f740 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=06ed3220-5ee6-4652-b2ec-6207531929d5,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:35.886614 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-48e8a0d7-0405-4f66-b600-117e73b0f740 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.890962 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-48e8a0d7-0405-4f66-b600-117e73b0f740 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1754174 Nov 12 15:00:35.892251 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60516) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:35.897464 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-8447cd15-bbf7-40ad-8cd8-a6931ed4713d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Request body: {'security_group_rule': {'security_group_id': '708da2d1-4d8f-46ad-af5e-34eafadae301', 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:35.913902 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59444c1a-9084-4b8f-bbf1-10a9f47c46ad x-openstack-request-id: req-59444c1a-9084-4b8f-bbf1-10a9f47c46ad {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:35.914454 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:35.914884 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-59444c1a-9084-4b8f-bbf1-10a9f47c46ad {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:35.915570 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'status': 'completed', 'code': 200} Nov 12 15:00:35.927536 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8447cd15-bbf7-40ad-8cd8-a6931ed4713d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.935276 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-46ceee9a-8c4f-4516-b359-3b233a9d4ecd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:35.936998 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-46ceee9a-8c4f-4516-b359-3b233a9d4ecd service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 1097 time: 0.0592589 Nov 12 15:00:35.984563 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-85ff63b3-8573-482b-9a78-38b046c69350 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac HTTP/1.1" status: 200 len: 217 time: 0.0386617 Nov 12 15:00:35.993694 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8447cd15-bbf7-40ad-8cd8-a6931ed4713d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:35.998385 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8447cd15-bbf7-40ad-8cd8-a6931ed4713d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.019491 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8447cd15-bbf7-40ad-8cd8-a6931ed4713d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5edb90b8-4045-487d-b164-e47ac242711c,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:36.027982 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8447cd15-bbf7-40ad-8cd8-a6931ed4713d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.031319 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-8447cd15-bbf7-40ad-8cd8-a6931ed4713d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1371715 Nov 12 15:00:36.033553 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60518) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:36.039859 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-9fce2980-32eb-4e29-9636-f09a0a33eea6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Request body: {'security_group_rule': {'security_group_id': '708da2d1-4d8f-46ad-af5e-34eafadae301', 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:36.046415 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-5b0d2ff4-05c6-43b8-b982-a48212ef2a9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:36.047929 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-5b0d2ff4-05c6-43b8-b982-a48212ef2a9f service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0571451 Nov 12 15:00:36.078472 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9fce2980-32eb-4e29-9636-f09a0a33eea6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.106323 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-590ade54-86fd-444a-9533-a17e03a738c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:36.108970 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-590ade54-86fd-444a-9533-a17e03a738c2 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0534692 Nov 12 15:00:36.148220 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9fce2980-32eb-4e29-9636-f09a0a33eea6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.156779 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9fce2980-32eb-4e29-9636-f09a0a33eea6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.174595 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fce2980-32eb-4e29-9636-f09a0a33eea6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2ad02c5b-5f3e-4ebf-9741-24026ce5e51d,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:36.187312 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9fce2980-32eb-4e29-9636-f09a0a33eea6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.189284 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-9fce2980-32eb-4e29-9636-f09a0a33eea6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1544690 Nov 12 15:00:36.192531 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60522) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:36.197274 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-1de56811-feb0-43c0-aff8-3d70f626d4cb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Request body: {'security_group_rule': {'security_group_id': '708da2d1-4d8f-46ad-af5e-34eafadae301', 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:36.228487 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1de56811-feb0-43c0-aff8-3d70f626d4cb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.268896 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-cd220a41-694b-4a4f-a2dd-893251111144 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1524460 Nov 12 15:00:36.309439 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1de56811-feb0-43c0-aff8-3d70f626d4cb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.314885 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1de56811-feb0-43c0-aff8-3d70f626d4cb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.334497 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de56811-feb0-43c0-aff8-3d70f626d4cb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=44556e86-594a-460c-844b-82113b1818fb,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:36.342869 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1de56811-feb0-43c0-aff8-3d70f626d4cb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.343356 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-864e763e-0517-43ee-b28e-3b5e87f80bcc req-0cef9cd3-235d-43bc-b381-ba9f56b85be2 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:36.344929 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-864e763e-0517-43ee-b28e-3b5e87f80bcc req-0cef9cd3-235d-43bc-b381-ba9f56b85be2 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 944 time: 0.1094921 Nov 12 15:00:36.347401 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60524) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:36.347544 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-1de56811-feb0-43c0-aff8-3d70f626d4cb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1539524 Nov 12 15:00:36.351841 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-4b3bb8d8-ba45-4e6b-9f4a-0ab541612aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Request body: {'security_group_rule': {'security_group_id': '708da2d1-4d8f-46ad-af5e-34eafadae301', 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:36.414190 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 37ce8a4b-01d0-4c8c-8665-8f6627848b39 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:36.425462 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.securitygroups_db [None req-4b3bb8d8-ba45-4e6b-9f4a-0ab541612aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Project 49070bd2a8b542b3801c73a224b4bba5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 12 15:00:36.435065 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-69a8cb3d-969b-4199-a6cc-125c20e2d634 req-cb8bbd5e-8ff6-4a72-9d61-e8457ab5bc1e service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1564300 Nov 12 15:00:36.439983 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4b3bb8d8-ba45-4e6b-9f4a-0ab541612aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.459095 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-864e763e-0517-43ee-b28e-3b5e87f80bcc req-e6aa2a4a-40d9-4b7d-b7bc-671691ff153d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011317 Nov 12 15:00:36.481851 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1190aae-a340-41e6-966a-0b611d6e68d4 req-f2388b4a-0291-4c67-914f-bc6725e6bab5 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:36.483474 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d1190aae-a340-41e6-966a-0b611d6e68d4 req-f2388b4a-0291-4c67-914f-bc6725e6bab5 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 944 time: 0.0674229 Nov 12 15:00:36.523894 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:00:36.528007 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:36.528478 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.547258 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4b3bb8d8-ba45-4e6b-9f4a-0ab541612aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.555729 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4b3bb8d8-ba45-4e6b-9f4a-0ab541612aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.567590 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d1190aae-a340-41e6-966a-0b611d6e68d4 req-c35f7b5f-1a0f-48ac-8a24-ea9c9b7af902 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0690079 Nov 12 15:00:36.576303 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b55036-42db-4444-a817-da35ca0abfd2 req-822f49f8-ebf5-4fd5-8e13-30580399f28e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:36.577799 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-04b55036-42db-4444-a817-da35ca0abfd2 req-822f49f8-ebf5-4fd5-8e13-30580399f28e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 1097 time: 0.0734065 Nov 12 15:00:36.585937 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b3bb8d8-ba45-4e6b-9f4a-0ab541612aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=58fe912d-4e34-42ba-8ede-549314a2c411,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:36.601807 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Sync routers for ids ['91c37de3-bf30-4b11-bf97-996a0d1b7691'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:36.608013 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4b3bb8d8-ba45-4e6b-9f4a-0ab541612aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.609395 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-4b3bb8d8-ba45-4e6b-9f4a-0ab541612aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2609701 Nov 12 15:00:36.612167 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60528) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:36.616615 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Routers {'91c37de3-bf30-4b11-bf97-996a0d1b7691'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:36.617281 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['91c37de3-bf30-4b11-bf97-996a0d1b7691'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:36.618698 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-c1f55e35-92f3-41d0-ab6f-d277248b09d1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Request body: {'security_group_rule': {'security_group_id': '708da2d1-4d8f-46ad-af5e-34eafadae301', 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:36.627636 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.654749 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.securitygroups_db [None req-c1f55e35-92f3-41d0-ab6f-d277248b09d1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Project 49070bd2a8b542b3801c73a224b4bba5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 12 15:00:36.661785 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c1f55e35-92f3-41d0-ab6f-d277248b09d1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.664836 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:36.667915 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64a018a2-bb86-4d94-8812-ecacbb1ca9ae" -d '{"events": [{"server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "name": "network-vif-plugged", "status": "completed", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:36.683512 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 37ce8a4b-01d0-4c8c-8665-8f6627848b39, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:36.688861 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.689762 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device dd7d017f-a94d-4100-a980-fc29d066f333 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:36.703324 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b55036-42db-4444-a817-da35ca0abfd2 req-91f4ca52-0023-4bb7-a631-2cd24ea597fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:36.705211 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-04b55036-42db-4444-a817-da35ca0abfd2 req-91f4ca52-0023-4bb7-a631-2cd24ea597fe service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.1070435 Nov 12 15:00:36.760208 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-04b55036-42db-4444-a817-da35ca0abfd2 req-af62dca2-3b6c-4331-93e7-8f4b176297ee service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac HTTP/1.1" status: 200 len: 217 time: 0.0461435 Nov 12 15:00:36.762778 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=37ce8a4b-01d0-4c8c-8665-8f6627848b39,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:36.789942 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Set router 91c37de3-bf30-4b11-bf97-996a0d1b7691 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:36.806896 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port dd7d017f-a94d-4100-a980-fc29d066f333 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:00:36.812231 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port dd7d017f-a94d-4100-a980-fc29d066f333 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:36.812912 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.818980 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c1f55e35-92f3-41d0-ab6f-d277248b09d1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.824659 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c1f55e35-92f3-41d0-ab6f-d277248b09d1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.828870 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b55036-42db-4444-a817-da35ca0abfd2 req-44461324-a139-4699-99a1-1c19724b1914 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:36.830947 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-04b55036-42db-4444-a817-da35ca0abfd2 req-44461324-a139-4699-99a1-1c19724b1914 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0628886 Nov 12 15:00:36.866703 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1f55e35-92f3-41d0-ab6f-d277248b09d1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=56e1d3d3-5c38-4119-8175-3b2f723be26a,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:36.870987 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4773b0e9-2a69-4f64-a493-879e7b5cb215 x-openstack-request-id: req-4773b0e9-2a69-4f64-a493-879e7b5cb215 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:36.871292 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "name": "network-vif-plugged", "status": "completed", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:36.876102 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-4773b0e9-2a69-4f64-a493-879e7b5cb215 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:36.877108 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'code': 200} Nov 12 15:00:36.916608 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c1f55e35-92f3-41d0-ab6f-d277248b09d1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:36.917910 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-c1f55e35-92f3-41d0-ab6f-d277248b09d1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3044715 Nov 12 15:00:36.963236 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04b55036-42db-4444-a817-da35ca0abfd2 req-064f1a79-1165-4c9b-b3d1-7c7eb73d6db3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:36.964810 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-04b55036-42db-4444-a817-da35ca0abfd2 req-064f1a79-1165-4c9b-b3d1-7c7eb73d6db3 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1252284 Nov 12 15:00:37.027067 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064404fe-89d0-431c-8c3c-44706c0fbd47 req-48830fc0-23d4-4877-8c1d-b393acce1dac tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:37.029135 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-064404fe-89d0-431c-8c3c-44706c0fbd47 req-48830fc0-23d4-4877-8c1d-b393acce1dac tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.1101506 Nov 12 15:00:37.068540 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:37.106808 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214'}], 'enable_snat': True}, 'gw_port_id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:27Z', 'updated_at': '2021-11-12T15:00:33Z', 'revision_number': 4, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'gw_port': {'id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:9f:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:29Z', 'updated_at': '2021-11-12T15:00:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'cd8e036b-d217-4fa6-940d-9fc14004e5e6', 'name': '', 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'mac_address': 'fa:16:3e:f6:a0:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '349dd9b2-ae54-4bac-b2af-edcb3af1d07c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:32Z', 'updated_at': '2021-11-12T15:00:33Z', 'revision_number': 2, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'subnets': [{'id': '349dd9b2-ae54-4bac-b2af-edcb3af1d07c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:37.139350 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Checking router: 91c37de3-bf30-4b11-bf97-996a0d1b7691 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:37.139711 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Updating router 91c37de3-bf30-4b11-bf97-996a0d1b7691 port cd8e036b-d217-4fa6-940d-9fc14004e5e6 binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 15:00:37.154416 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-064404fe-89d0-431c-8c3c-44706c0fbd47 req-08a50ae6-0dad-4ab9-b5ea-41f73151c810 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1189902 Nov 12 15:00:37.175987 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.181331 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:37.182328 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.185571 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.214498 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24265ed8-20d0-4eca-8705-9d373e1163d3 req-482a7467-d619-4231-8f07-a2bb5a2fdbf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:37.216010 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-24265ed8-20d0-4eca-8705-9d373e1163d3 req-482a7467-d619-4231-8f07-a2bb5a2fdbf1 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1098 time: 0.0805657 Nov 12 15:00:37.261977 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port dd7d017f-a94d-4100-a980-fc29d066f333, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=dd7d017f-a94d-4100-a980-fc29d066f333,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:37.268043 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.268275 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-04b55036-42db-4444-a817-da35ca0abfd2 req-d160f86c-a4e6-4a4b-a048-675925e2acb3 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2959027 Nov 12 15:00:37.305705 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-24265ed8-20d0-4eca-8705-9d373e1163d3 req-ea5d36fc-b2f6-487c-8ee8-1e0e30078c93 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0818636 Nov 12 15:00:37.359887 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=dd7d017f-a94d-4100-a980-fc29d066f333,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:37.398806 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-04b55036-42db-4444-a817-da35ca0abfd2 req-711ded47-b5a2-475d-9f60-11249ea8a823 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1191397 Nov 12 15:00:37.515319 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.521097 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.569737 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21acd00a-3355-4cd4-81c5-a627e2b47553 None None] Pushing event updated for resources: {'Port': ['ID=cd8e036b-d217-4fa6-940d-9fc14004e5e6,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:37.650329 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab058470-cfb5-405a-b92c-e854a6abc970 req-cefe1b6d-f52b-43eb-b445-cb791b25b88d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:37.653671 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ab058470-cfb5-405a-b92c-e854a6abc970 req-cefe1b6d-f52b-43eb-b445-cb791b25b88d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 945 time: 0.0619726 Nov 12 15:00:37.661476 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Attempting to bind port cd8e036b-d217-4fa6-940d-9fc14004e5e6 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:37.662113 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Attempting to bind port cd8e036b-d217-4fa6-940d-9fc14004e5e6 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '6b7c6928-b12a-4c48-a905-46863b8c9b31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:37.662493 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Attempting to bind port cd8e036b-d217-4fa6-940d-9fc14004e5e6 on network 9ea4059b-341e-435e-a2c5-0eadc56bb957 {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:37.676265 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:37.676905 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Checking segment: {'id': '6b7c6928-b12a-4c48-a905-46863b8c9b31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:37.677408 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.677913 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Bound using segment: {'id': '6b7c6928-b12a-4c48-a905-46863b8c9b31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:37.678500 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Bound port: cd8e036b-d217-4fa6-940d-9fc14004e5e6, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6b7c6928-b12a-4c48-a905-46863b8c9b31', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:37.679028 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.723509 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3acd774d-9651-4547-9f76-8bafa446c70a req-c17cd49b-1126-45ac-996a-1439466e953a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:37.734233 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3acd774d-9651-4547-9f76-8bafa446c70a req-c17cd49b-1126-45ac-996a-1439466e953a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 945 time: 0.0938494 Nov 12 15:00:37.737715 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ab058470-cfb5-405a-b92c-e854a6abc970 req-4732b068-a89b-44e0-bc15-276e2da5ad0a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786796 Nov 12 15:00:37.769162 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] For port cd8e036b-d217-4fa6-940d-9fc14004e5e6, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:37.774489 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] For port cd8e036b-d217-4fa6-940d-9fc14004e5e6, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=cd8e036b-d217-4fa6-940d-9fc14004e5e6,segment=NetworkSegment(6b7c6928-b12a-4c48-a905-46863b8c9b31),segment_id=6b7c6928-b12a-4c48-a905-46863b8c9b31)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:37.779833 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.818735 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3acd774d-9651-4547-9f76-8bafa446c70a req-89c61c83-d9ac-4759-afad-c1bff51365c0 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0775368 Nov 12 15:00:37.854484 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Routers {'91c37de3-bf30-4b11-bf97-996a0d1b7691'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:37.855119 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['91c37de3-bf30-4b11-bf97-996a0d1b7691'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:37.862493 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-86ea6d4f-6418-4d15-aa8c-355360a46a88 None None] Provisioning complete for port cd8e036b-d217-4fa6-940d-9fc14004e5e6 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:37.862997 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-86ea6d4f-6418-4d15-aa8c-355360a46a88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.898460 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21acd00a-3355-4cd4-81c5-a627e2b47553 None None] Pushing event updated for resources: {'Port': ['ID=cd8e036b-d217-4fa6-940d-9fc14004e5e6,revision_number=4']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:37.972163 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-86ea6d4f-6418-4d15-aa8c-355360a46a88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:37.973177 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] Set router 91c37de3-bf30-4b11-bf97-996a0d1b7691 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:38.007347 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-86ea6d4f-6418-4d15-aa8c-355360a46a88 None None] For port cd8e036b-d217-4fa6-940d-9fc14004e5e6, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=cd8e036b-d217-4fa6-940d-9fc14004e5e6,segment=NetworkSegment(6b7c6928-b12a-4c48-a905-46863b8c9b31),segment_id=6b7c6928-b12a-4c48-a905-46863b8c9b31)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:38.011245 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-86ea6d4f-6418-4d15-aa8c-355360a46a88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:38.065152 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ea6d4f-6418-4d15-aa8c-355360a46a88 None None] Pushing event updated for resources: {'Port': ['ID=cd8e036b-d217-4fa6-940d-9fc14004e5e6,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:38.135974 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-886fc275-87b6-42de-8ad4-c3a82811df7d None None] Provisioning complete for port cd8e036b-d217-4fa6-940d-9fc14004e5e6 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:38.136298 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-886fc275-87b6-42de-8ad4-c3a82811df7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:38.187732 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214'}], 'enable_snat': True}, 'gw_port_id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:27Z', 'updated_at': '2021-11-12T15:00:33Z', 'revision_number': 4, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'gw_port': {'id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:9f:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:29Z', 'updated_at': '2021-11-12T15:00:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'cd8e036b-d217-4fa6-940d-9fc14004e5e6', 'name': '', 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'mac_address': 'fa:16:3e:f6:a0:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '349dd9b2-ae54-4bac-b2af-edcb3af1d07c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:32Z', 'updated_at': '2021-11-12T15:00:37Z', 'revision_number': 4, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'subnets': [{'id': '349dd9b2-ae54-4bac-b2af-edcb3af1d07c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:38.216364 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c3f2676-13a8-4ffc-9b5c-e202f8642ed2 None None] The sync data for ids ['91c37de3-bf30-4b11-bf97-996a0d1b7691'] in dv-cinder-776422-5-iscsi is: [{'id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214'}], 'enable_snat': True}, 'gw_port_id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:27Z', 'updated_at': '2021-11-12T15:00:33Z', 'revision_number': 4, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'gw_port': {'id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:9f:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:29Z', 'updated_at': '2021-11-12T15:00:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'cd8e036b-d217-4fa6-940d-9fc14004e5e6', 'name': '', 'network_id': '9ea4059b-341e-435e-a2c5-0eadc56bb957', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'mac_address': 'fa:16:3e:f6:a0:25', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '349dd9b2-ae54-4bac-b2af-edcb3af1d07c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:32Z', 'updated_at': '2021-11-12T15:00:37Z', 'revision_number': 4, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'subnets': [{'id': '349dd9b2-ae54-4bac-b2af-edcb3af1d07c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:38.287118 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8286d4ff-d140-41df-82cc-1ae31cf19e05 req-1bd7104d-03f8-4836-9601-985c832640e4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:38.289399 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8286d4ff-d140-41df-82cc-1ae31cf19e05 req-1bd7104d-03f8-4836-9601-985c832640e4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0673952 Nov 12 15:00:38.349018 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8286d4ff-d140-41df-82cc-1ae31cf19e05 req-fd6b1fe5-834d-49df-b776-1f6470adba0f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0535686 Nov 12 15:00:38.428920 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:00:38.538732 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:38.551983 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'port_id': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'mac_address': 'fa:16:3e:50:13:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 638, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:00:38.595942 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:38.610180 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b0bd777f-598e-4de7-ab20-79ef7b06cdac {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:00:38.636051 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:38.640562 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:38.692500 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:38.872575 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device cd8e036b-d217-4fa6-940d-9fc14004e5e6 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:38.878879 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd7d017f-a94d-4100-a980-fc29d066f333'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:38.881762 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e9cf49c-b154-4339-a9f4-b6033e6f447f" -d '{"events": [{"server_uuid": "4890b09a-fc1a-4d2a-89bf-35b5c775d762", "name": "network-vif-plugged", "status": "completed", "tag": "dd7d017f-a94d-4100-a980-fc29d066f333"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:38.885202 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13d86868-2b30-4796-aeb1-379df404c872 req-a7d64f6f-9851-4b3f-8680-f3dd7eded862 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:38.886766 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-13d86868-2b30-4796-aeb1-379df404c872 req-a7d64f6f-9851-4b3f-8680-f3dd7eded862 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 945 time: 0.0636590 Nov 12 15:00:38.888363 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['b0bd777f-598e-4de7-ab20-79ef7b06cdac'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:00:38.966353 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-13d86868-2b30-4796-aeb1-379df404c872 req-74895948-0309-4cfb-a354-8f1b88441134 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712163 Nov 12 15:00:38.989581 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b80e6777-e4e5-4ff9-8bd1-265fa7a25f4e req-7f4ca5f9-b934-4eb8-b28f-06f75a5a6dd8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:38.989581 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b80e6777-e4e5-4ff9-8bd1-265fa7a25f4e req-7f4ca5f9-b934-4eb8-b28f-06f75a5a6dd8 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 945 time: 0.0821621 Nov 12 15:00:39.021756 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port cd8e036b-d217-4fa6-940d-9fc14004e5e6 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:39.022203 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:39.061588 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b80e6777-e4e5-4ff9-8bd1-265fa7a25f4e req-a43ce7ad-0000-42dc-b8bc-9e10916c92da tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0636499 Nov 12 15:00:39.062133 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0fdf87d2-c1b2-45de-b412-9de084d08c16 x-openstack-request-id: req-0fdf87d2-c1b2-45de-b412-9de084d08c16 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:39.062474 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4890b09a-fc1a-4d2a-89bf-35b5c775d762", "name": "network-vif-plugged", "status": "completed", "tag": "dd7d017f-a94d-4100-a980-fc29d066f333", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:39.062733 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-0fdf87d2-c1b2-45de-b412-9de084d08c16 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:39.063322 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd7d017f-a94d-4100-a980-fc29d066f333', 'code': 200} Nov 12 15:00:39.169571 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d84a887b-011a-46c3-bdb4-b3d47953e717 req-a821adf2-1613-4a57-85c2-820ab163bfe5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:39.178281 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d84a887b-011a-46c3-bdb4-b3d47953e717 req-a821adf2-1613-4a57-85c2-820ab163bfe5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 945 time: 0.0693731 Nov 12 15:00:39.231005 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d84a887b-011a-46c3-bdb4-b3d47953e717 req-c94e9ead-dedb-4720-b239-ad05b18dff3a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514920 Nov 12 15:00:39.256756 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ce33c1-d6b3-4eac-a94c-f82f274636bc req-4654f778-9a73-4567-acc2-5a3480dd19fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:39.258630 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d1ce33c1-d6b3-4eac-a94c-f82f274636bc req-4654f778-9a73-4567-acc2-5a3480dd19fc service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 1098 time: 0.0578766 Nov 12 15:00:39.306332 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d1ce33c1-d6b3-4eac-a94c-f82f274636bc req-adf11941-b838-4255-96dc-c9331b85754a service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397677 Nov 12 15:00:39.468319 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12876a2a-563d-4cd6-8717-92e46d021536 req-b80c4c93-a6aa-4fa6-a331-17b3cb12e1f0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:39.469827 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-12876a2a-563d-4cd6-8717-92e46d021536 req-b80c4c93-a6aa-4fa6-a331-17b3cb12e1f0 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 945 time: 0.0493879 Nov 12 15:00:39.520725 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-12876a2a-563d-4cd6-8717-92e46d021536 req-dc2c131e-0e55-406b-9413-c51fc7cd561e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0444589 Nov 12 15:00:39.577577 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f2979f-aa14-4a2b-aec6-b676253c637a req-0beddc3f-da16-42e9-b3a3-082610c5be84 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:39.579045 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18f2979f-aa14-4a2b-aec6-b676253c637a req-0beddc3f-da16-42e9-b3a3-082610c5be84 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 945 time: 0.0538340 Nov 12 15:00:39.627667 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18f2979f-aa14-4a2b-aec6-b676253c637a req-75a51607-167a-4535-9584-554a638a4065 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420218 Nov 12 15:00:40.194779 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bef6ec7-6b07-48b6-9836-c97a394ee38b req-93594474-1359-48ca-8646-5c69bc2d6f3c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:40.196382 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9bef6ec7-6b07-48b6-9836-c97a394ee38b req-93594474-1359-48ca-8646-5c69bc2d6f3c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 945 time: 0.0543511 Nov 12 15:00:40.246595 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9bef6ec7-6b07-48b6-9836-c97a394ee38b req-6b1e04af-4e3b-4354-b2da-0dd62bb9c9b0 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439904 Nov 12 15:00:40.446485 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:00:40.493911 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port b0bd777f-598e-4de7-ab20-79ef7b06cdac completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:00:40.498533 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port b0bd777f-598e-4de7-ab20-79ef7b06cdac triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:40.498961 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:40.587863 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:40.630505 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:40.634743 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:40.661499 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8208c3-6f1d-4555-bcb7-e8bbce2b1fde req-b5049e99-fe1a-42a5-8fee-740e9d2d849b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:40.665319 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2e8208c3-6f1d-4555-bcb7-e8bbce2b1fde req-b5049e99-fe1a-42a5-8fee-740e9d2d849b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 945 time: 0.0571547 Nov 12 15:00:40.690342 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:40.719711 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2e8208c3-6f1d-4555-bcb7-e8bbce2b1fde req-bd674302-cfcc-4f11-bb8f-4639fd5112cb tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0466135 Nov 12 15:00:41.064945 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:41.067963 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20c0e6f6-d419-4248-b6bf-cf80bc9bc83b" -d '{"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-plugged", "status": "completed", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:41.107471 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0d168e3-b420-41ae-965c-7e77c53d3b87 x-openstack-request-id: req-f0d168e3-b420-41ae-965c-7e77c53d3b87 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:41.107805 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-plugged", "status": "completed", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:41.108255 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f0d168e3-b420-41ae-965c-7e77c53d3b87 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:41.108652 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'code': 200} Nov 12 15:00:41.292203 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7151331-7617-42f0-9d19-25def9809712 req-86cef23a-512a-4943-a49c-f9411598bdb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:41.294334 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f7151331-7617-42f0-9d19-25def9809712 req-86cef23a-512a-4943-a49c-f9411598bdb3 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 1099 time: 0.0487108 Nov 12 15:00:41.352230 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f7151331-7617-42f0-9d19-25def9809712 req-56415dbb-a046-4004-b26f-fbff965a594e service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0453544 Nov 12 15:00:41.390832 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c392c4-4bfa-4e5f-b139-3f492fcbb581 req-736d1422-740d-498a-8079-e4104341eb0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:41.392640 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-14c392c4-4bfa-4e5f-b139-3f492fcbb581 req-736d1422-740d-498a-8079-e4104341eb0b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 945 time: 0.0606809 Nov 12 15:00:41.445550 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-14c392c4-4bfa-4e5f-b139-3f492fcbb581 req-0b00d12e-9721-42df-b24f-204e049ba395 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470104 Nov 12 15:00:41.564501 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78f8439d-e309-435e-aeb5-69f3cf237ca2 req-67a3b5b3-d183-462b-8b72-10904d0e163c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:41.565990 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-78f8439d-e309-435e-aeb5-69f3cf237ca2 req-67a3b5b3-d183-462b-8b72-10904d0e163c tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 945 time: 0.0524695 Nov 12 15:00:41.574565 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60650) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:41.579206 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-6eb76411-7fcf-4425-bedc-589af24ac52a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Request body: {'floatingip': {'port_id': 'dd7d017f-a94d-4100-a980-fc29d066f333'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:41.623518 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6eb76411-7fcf-4425-bedc-589af24ac52a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:41.914325 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5351e5a9-ae29-43d7-8a5a-83ca49cf2260 req-7eff908d-5f69-48c9-aa55-eb84ccd3026e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:41.915786 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5351e5a9-ae29-43d7-8a5a-83ca49cf2260 req-7eff908d-5f69-48c9-aa55-eb84ccd3026e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.1201713 Nov 12 15:00:42.040195 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5351e5a9-ae29-43d7-8a5a-83ca49cf2260 req-1be9ef3d-1c12-4086-8dcf-def5d315e6f9 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1174896 Nov 12 15:00:42.153532 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6eb76411-7fcf-4425-bedc-589af24ac52a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:42.157426 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6eb76411-7fcf-4425-bedc-589af24ac52a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:42.256132 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.l3_db [None req-6eb76411-7fcf-4425-bedc-589af24ac52a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Floating IP ba5a13eb-50e3-4e0f-8f17-d9a263efde9f associated. External IP: 172.27.3.179, port: dd7d017f-a94d-4100-a980-fc29d066f333. Nov 12 15:00:42.466465 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6eb76411-7fcf-4425-bedc-589af24ac52a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Router a08d9f45-c652-4276-867c-ab77c8f81aef has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:00:42.573707 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6eb76411-7fcf-4425-bedc-589af24ac52a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:42.578400 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-6eb76411-7fcf-4425-bedc-589af24ac52a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:42.582824 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] Sync routers for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:42.592518 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:42.593139 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:42.607640 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6eb76411-7fcf-4425-bedc-589af24ac52a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "PUT /v2.0/floatingips/ba5a13eb-50e3-4e0f-8f17-d9a263efde9f HTTP/1.1" status: 200 len: 991 time: 1.0319083 Nov 12 15:00:42.609120 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'tag': 'dd7d017f-a94d-4100-a980-fc29d066f333'}] {{(pid=101617) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:42.610961 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a89741189a1474522a3f12d6512a4dfa907db76ed85a3c525a03538a87d7317" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7413e67-f2f3-41c8-84c4-067be303979a" -d '{"events": [{"name": "network-changed", "server_uuid": "4890b09a-fc1a-4d2a-89bf-35b5c775d762", "tag": "dd7d017f-a94d-4100-a980-fc29d066f333"}]}' {{(pid=101617) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:42.707603 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-84f39a0a-e34a-405a-810d-8b8c3ed3596f x-openstack-request-id: req-84f39a0a-e34a-405a-810d-8b8c3ed3596f {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:42.708140 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4890b09a-fc1a-4d2a-89bf-35b5c775d762", "tag": "dd7d017f-a94d-4100-a980-fc29d066f333", "status": "completed", "code": 200}]} {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:42.709026 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-84f39a0a-e34a-405a-810d-8b8c3ed3596f {{(pid=101617) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:42.709026 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'tag': 'dd7d017f-a94d-4100-a980-fc29d066f333', 'status': 'completed', 'code': 200} Nov 12 15:00:42.716704 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:42.802419 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7413e67-f2f3-41c8-84c4-067be303979a req-b35ad13b-88ea-4de8-b414-b3171aeeff54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:42.803920 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a7413e67-f2f3-41c8-84c4-067be303979a req-b35ad13b-88ea-4de8-b414-b3171aeeff54 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 1098 time: 0.0547709 Nov 12 15:00:42.923650 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7413e67-f2f3-41c8-84c4-067be303979a req-f659ba28-d796-436c-ae58-5d7a6b166848 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:42.926190 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a7413e67-f2f3-41c8-84c4-067be303979a req-f659ba28-d796-436c-ae58-5d7a6b166848 service neutron] 10.222.0.86 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 912 time: 0.1050334 Nov 12 15:00:43.031136 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a7413e67-f2f3-41c8-84c4-067be303979a req-a2e96a43-9e87-4d2b-a3a8-f6d72633ec5a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd7d017f-a94d-4100-a980-fc29d066f333 HTTP/1.1" status: 200 len: 999 time: 0.0971313 Nov 12 15:00:43.057933 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': 'ba5a13eb-50e3-4e0f-8f17-d9a263efde9f', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'floating_ip_address': '172.27.3.179', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'port_id': 'dd7d017f-a94d-4100-a980-fc29d066f333', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'mac_address': 'fa:16:3e:f3:7e:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:00:11Z', 'updated_at': '2021-11-12T15:00:42Z', 'revision_number': 1, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:43.086607 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] Checking router: a08d9f45-c652-4276-867c-ab77c8f81aef for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:43.088289 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7413e67-f2f3-41c8-84c4-067be303979a req-b90fd156-6180-4cde-ae88-c39f4e8885b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:43.089847 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a7413e67-f2f3-41c8-84c4-067be303979a req-b90fd156-6180-4cde-ae88-c39f4e8885b1 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 200 len: 850 time: 0.0496254 Nov 12 15:00:43.095976 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:43.096637 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:43.140754 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7413e67-f2f3-41c8-84c4-067be303979a req-3b63fa86-bcdb-4108-b3f6-7c7fa219f623 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:43.142550 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a7413e67-f2f3-41c8-84c4-067be303979a req-3b63fa86-bcdb-4108-b3f6-7c7fa219f623 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0449181 Nov 12 15:00:43.184690 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d54c9b78-b874-4bb6-914f-9aeb594eadb6 req-137565d7-a06b-40e1-9d7d-2d0d3acd2dec tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:43.187107 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d54c9b78-b874-4bb6-914f-9aeb594eadb6 req-137565d7-a06b-40e1-9d7d-2d0d3acd2dec tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0581148 Nov 12 15:00:43.226852 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:43.239629 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d54c9b78-b874-4bb6-914f-9aeb594eadb6 req-0153445b-1a59-4cfe-a5ab-5929cc14a630 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0441496 Nov 12 15:00:43.240958 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a7413e67-f2f3-41c8-84c4-067be303979a req-268639e4-bb36-40ec-92c7-3eb6bd6c5887 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0903511 Nov 12 15:00:43.375780 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a7413e67-f2f3-41c8-84c4-067be303979a req-c23b6ab5-2eff-44e1-82f8-fcaaf5b26114 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1239309 Nov 12 15:00:43.390749 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9700f89-b74b-40e6-81ea-06a27f998dfc req-347d8b30-325d-4070-bd3d-5af731afb2b8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:43.390749 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f9700f89-b74b-40e6-81ea-06a27f998dfc req-347d8b30-325d-4070-bd3d-5af731afb2b8 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0742223 Nov 12 15:00:43.399775 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60670) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:43.405720 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Request body: {'floatingip': {'port_id': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:43.447261 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:43.490923 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': 'ba5a13eb-50e3-4e0f-8f17-d9a263efde9f', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'floating_ip_address': '172.27.3.179', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'port_id': 'dd7d017f-a94d-4100-a980-fc29d066f333', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'mac_address': 'fa:16:3e:f3:7e:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:00:11Z', 'updated_at': '2021-11-12T15:00:42Z', 'revision_number': 1, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:43.641354 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34e5e347-5e9c-4503-ae12-fc8308cb4d90 None None] The sync data for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi is: [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': 'ba5a13eb-50e3-4e0f-8f17-d9a263efde9f', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'floating_ip_address': '172.27.3.179', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'port_id': 'dd7d017f-a94d-4100-a980-fc29d066f333', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'mac_address': 'fa:16:3e:f3:7e:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:00:11Z', 'updated_at': '2021-11-12T15:00:42Z', 'revision_number': 1, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:43.909194 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d384842d-c7af-446d-853b-0e7a7b9a2d3d None None] New status for floating IP ba5a13eb-50e3-4e0f-8f17-d9a263efde9f: ACTIVE {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:00:44.111679 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.db.resource_extend [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] It took 0.26 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 12 15:00:44.161110 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:44.165057 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:44.266448 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.l3_db [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Floating IP a8d92040-35ec-4248-98ce-6ba98302b214 associated. External IP: 172.27.3.70, port: b0bd777f-598e-4de7-ab20-79ef7b06cdac. Nov 12 15:00:44.479939 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Router 2b5b59a1-46c8-4703-94e6-adf835fba661 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:00:44.587633 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:44.591986 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:44.597162 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] Sync routers for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:44.607495 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:44.608130 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:44.629614 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-b7db8497-5099-4170-ac1c-afdc4003a5f5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "PUT /v2.0/floatingips/a8d92040-35ec-4248-98ce-6ba98302b214 HTTP/1.1" status: 200 len: 991 time: 1.2280881 Nov 12 15:00:44.711438 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac'}] {{(pid=101617) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:44.715025 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a89741189a1474522a3f12d6512a4dfa907db76ed85a3c525a03538a87d7317" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-782fe195-3e88-4187-b1aa-26ab3665d731" -d '{"events": [{"name": "network-changed", "server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac"}]}' {{(pid=101617) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:44.717989 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:44.754283 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6396beb-b889-424f-a65d-e5d2469fba26 x-openstack-request-id: req-b6396beb-b889-424f-a65d-e5d2469fba26 {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:44.755278 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac", "status": "completed", "code": 200}]} {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:44.755278 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b6396beb-b889-424f-a65d-e5d2469fba26 {{(pid=101617) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:44.755278 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'status': 'completed', 'code': 200} Nov 12 15:00:44.834313 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-cb733991-b360-4686-85f4-4adc1ae92b6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:44.835940 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-cb733991-b360-4686-85f4-4adc1ae92b6a service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 1099 time: 0.0424154 Nov 12 15:00:44.992474 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': 'a8d92040-35ec-4248-98ce-6ba98302b214', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'floating_ip_address': '172.27.3.70', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'port_id': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 517, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'mac_address': 'fa:16:3e:50:13:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:00:30Z', 'updated_at': '2021-11-12T15:00:43Z', 'revision_number': 1, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:45.020325 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] Checking router: 2b5b59a1-46c8-4703-94e6-adf835fba661 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:45.030415 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:45.031196 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:45.143684 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:45.211897 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-0903ffbb-13b9-46af-8f2e-29863dba0ffd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:45.213519 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-0903ffbb-13b9-46af-8f2e-29863dba0ffd service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.3649089 Nov 12 15:00:45.288248 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-f07a32a5-9d83-4e74-ab0f-17b1e340603a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac HTTP/1.1" status: 200 len: 999 time: 0.0642564 Nov 12 15:00:45.351999 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-98778e23-6cc0-4de6-bcf3-dddf1a0293e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:45.353581 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-98778e23-6cc0-4de6-bcf3-dddf1a0293e4 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0446222 Nov 12 15:00:45.380495 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': 'a8d92040-35ec-4248-98ce-6ba98302b214', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'floating_ip_address': '172.27.3.70', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'port_id': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 517, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'mac_address': 'fa:16:3e:50:13:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:00:30Z', 'updated_at': '2021-11-12T15:00:43Z', 'revision_number': 1, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:45.412875 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ecec001-fcf0-42d5-8777-c066d0a56ce5 None None] The sync data for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi is: [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': 'a8d92040-35ec-4248-98ce-6ba98302b214', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'floating_ip_address': '172.27.3.70', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'port_id': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 517, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'mac_address': 'fa:16:3e:50:13:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:00:30Z', 'updated_at': '2021-11-12T15:00:43Z', 'revision_number': 1, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:45.413518 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-c5fafdf5-0b1c-4e64-8d8a-a82ec8c1e9e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:45.415026 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-c5fafdf5-0b1c-4e64-8d8a-a82ec8c1e9e7 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0429645 Nov 12 15:00:45.511505 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-cedebae1-d7d4-45e7-a73e-052eacee77ff service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889988 Nov 12 15:00:45.597662 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2291db27-4f0e-4757-a86d-162a98520c68 None None] New status for floating IP a8d92040-35ec-4248-98ce-6ba98302b214: ACTIVE {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:00:45.609987 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-782fe195-3e88-4187-b1aa-26ab3665d731 req-e95bb571-7c3b-4e8f-9811-88612311b435 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908387 Nov 12 15:00:49.117937 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf8e1d2-e8a0-4bf7-87c9-e415b0c798b5 req-6e5309fd-6571-4f59-a401-2e2a67d6355e tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:49.119484 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2cf8e1d2-e8a0-4bf7-87c9-e415b0c798b5 req-6e5309fd-6571-4f59-a401-2e2a67d6355e tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 945 time: 0.0678256 Nov 12 15:00:49.183373 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2cf8e1d2-e8a0-4bf7-87c9-e415b0c798b5 req-cf08d1ae-5ddd-4977-b22b-e7a690dcca6b tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563719 Nov 12 15:00:49.208069 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60724) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:49.369179 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f15a367-f468-455a-be88-4e38f567618e tempest-TestMinimumBasicScenario-1362156278 tempest-TestMinimumBasicScenario-1362156278-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:49.370637 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-5f15a367-f468-455a-be88-4e38f567618e tempest-TestMinimumBasicScenario-1362156278 tempest-TestMinimumBasicScenario-1362156278-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1093 time: 0.1615477 Nov 12 15:00:49.373714 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60730) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:49.378776 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'floatingip': {'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'port_id': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'fixed_ip_address': '172.20.0.5'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:49.402242 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for floatingip, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:49.506586 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:49.632717 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Allocated IP 172.27.3.215 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/96d08a96-6fb3-4e3c-ba24-6415cf0258cf) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:49.784061 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:49.826370 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:49.871855 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:49.877742 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:49.883162 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:49.889181 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'Port': ['ID=96d08a96-6fb3-4e3c-ba24-6415cf0258cf,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:50.313886 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:50.394674 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:50.569490 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for port, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:50.574421 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7428717'] for port, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:50.646357 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'Port': ['ID=96d08a96-6fb3-4e3c-ba24-6415cf0258cf,revision_number=2']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:50.661116 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:50.768042 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.l3_db [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Floating IP 337c87a7-17f3-4142-8ac8-7c86a74bcfa4 associated. External IP: 172.27.3.215, port: 37ce8a4b-01d0-4c8c-8665-8f6627848b39. Nov 12 15:00:50.981177 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Router bd049b89-6c39-46a2-a0d7-61445958d280 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:00:51.101210 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:00:51.112195 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] Sync routers for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:00:51.120719 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.122980 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:51.123444 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:51.155481 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e6e0340d-e91c-46df-b717-499704f60b01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7803755 Nov 12 15:00:51.156270 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39'}] {{(pid=101617) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:51.158970 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60750) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:51.159512 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a89741189a1474522a3f12d6512a4dfa907db76ed85a3c525a03538a87d7317" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b130902b-796e-47e6-9e99-fedce84fb452" -d '{"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39"}]}' {{(pid=101617) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:51.170654 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-de609439-43e8-43ec-ad2a-554a17f42b7d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1360662033', 'description': 'tempest-secgroup-smoke-1360662033 description', 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:51.213313 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de609439-43e8-43ec-ad2a-554a17f42b7d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.225777 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8284ea35-ed5a-4883-bb2e-b8f051e751c3 x-openstack-request-id: req-8284ea35-ed5a-4883-bb2e-b8f051e751c3 {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:51.229764 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39", "status": "completed", "code": 200}]} {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:51.233713 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-8284ea35-ed5a-4883-bb2e-b8f051e751c3 {{(pid=101617) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:51.242817 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'status': 'completed', 'code': 200} Nov 12 15:00:51.256370 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:51.352171 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de609439-43e8-43ec-ad2a-554a17f42b7d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.355651 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b130902b-796e-47e6-9e99-fedce84fb452 req-c569c28d-15a6-4dc7-bd91-6008e83f5ce0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:51.357260 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b130902b-796e-47e6-9e99-fedce84fb452 req-c569c28d-15a6-4dc7-bd91-6008e83f5ce0 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1098 time: 0.0902977 Nov 12 15:00:51.360789 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de609439-43e8-43ec-ad2a-554a17f42b7d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.390181 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de609439-43e8-43ec-ad2a-554a17f42b7d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.391685 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-de609439-43e8-43ec-ad2a-554a17f42b7d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2315524 Nov 12 15:00:51.394832 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60758) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:51.399932 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-db5b7b75-f784-4848-a05f-e6a41015dd47 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'security_group_rule': {'security_group_id': 'ffdab7b5-4d64-44ab-bdca-dfd461f30c9f', 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:51.415496 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de609439-43e8-43ec-ad2a-554a17f42b7d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:51.437774 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-db5b7b75-f784-4848-a05f-e6a41015dd47 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.502302 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b130902b-796e-47e6-9e99-fedce84fb452 req-e5eff320-5928-489c-99f0-d190ad04bae3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:51.503741 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b130902b-796e-47e6-9e99-fedce84fb452 req-e5eff320-5928-489c-99f0-d190ad04bae3 service neutron] 10.222.0.86 "GET /v2.0/networks?id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 200 len: 915 time: 0.1207738 Nov 12 15:00:51.511601 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-db5b7b75-f784-4848-a05f-e6a41015dd47 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.515559 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-db5b7b75-f784-4848-a05f-e6a41015dd47 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.527902 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '337c87a7-17f3-4142-8ac8-7c86a74bcfa4', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'floating_ip_address': '172.27.3.215', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'port_id': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 530, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'mac_address': 'fa:16:3e:f2:ce:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:00:50Z', 'updated_at': '2021-11-12T15:00:50Z', 'revision_number': 0, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 5, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:51.538591 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db5b7b75-f784-4848-a05f-e6a41015dd47 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c9cc0350-5207-4a33-bf31-59bf87e99eb4,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:51.551295 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-db5b7b75-f784-4848-a05f-e6a41015dd47 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.555882 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-db5b7b75-f784-4848-a05f-e6a41015dd47 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1567647 Nov 12 15:00:51.556723 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60762) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:51.558044 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] Checking router: bd049b89-6c39-46a2-a0d7-61445958d280 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:00:51.561317 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-df88a374-f044-47bd-b4b5-609ad0f55173 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'security_group_rule': {'security_group_id': 'ffdab7b5-4d64-44ab-bdca-dfd461f30c9f', 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:51.567386 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:00:51.568277 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:51.591900 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-df88a374-f044-47bd-b4b5-609ad0f55173 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.598187 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b130902b-796e-47e6-9e99-fedce84fb452 req-4bf88d86-1eb9-45e7-9760-e3e8af6b2b92 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 999 time: 0.0805008 Nov 12 15:00:51.657137 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b130902b-796e-47e6-9e99-fedce84fb452 req-b66bec8a-db9a-4af6-9536-1581423f0ef9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:51.658633 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b130902b-796e-47e6-9e99-fedce84fb452 req-b66bec8a-db9a-4af6-9536-1581423f0ef9 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 HTTP/1.1" status: 200 len: 853 time: 0.0519280 Nov 12 15:00:51.662628 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-df88a374-f044-47bd-b4b5-609ad0f55173 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.666815 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-df88a374-f044-47bd-b4b5-609ad0f55173 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.688058 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df88a374-f044-47bd-b4b5-609ad0f55173 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80b6d918-0170-48dc-a0c9-1b3aed12abe0,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:51.692026 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:00:51.701582 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-df88a374-f044-47bd-b4b5-609ad0f55173 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.703501 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-df88a374-f044-47bd-b4b5-609ad0f55173 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1456871 Nov 12 15:00:51.708039 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60764) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:51.710824 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-0fda3fdd-df77-41a6-87e6-34ddc821a7f1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'security_group_rule': {'security_group_id': 'ffdab7b5-4d64-44ab-bdca-dfd461f30c9f', 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:51.723915 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b130902b-796e-47e6-9e99-fedce84fb452 req-4abbf33f-a31a-4f99-99f2-40cddc044f0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:51.725460 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b130902b-796e-47e6-9e99-fedce84fb452 req-4abbf33f-a31a-4f99-99f2-40cddc044f0c service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0592263 Nov 12 15:00:51.745511 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0fda3fdd-df77-41a6-87e6-34ddc821a7f1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.810713 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0fda3fdd-df77-41a6-87e6-34ddc821a7f1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.815343 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0fda3fdd-df77-41a6-87e6-34ddc821a7f1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.835207 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fda3fdd-df77-41a6-87e6-34ddc821a7f1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d3ebe63c-32b9-4444-b927-4ec0938e1e9a,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:51.843320 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b130902b-796e-47e6-9e99-fedce84fb452 req-a5693e43-1ee2-43d4-92dc-d20491c0a5fa service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1092534 Nov 12 15:00:51.847958 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0fda3fdd-df77-41a6-87e6-34ddc821a7f1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.849263 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-0fda3fdd-df77-41a6-87e6-34ddc821a7f1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1421247 Nov 12 15:00:51.852047 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60766) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:51.857028 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-1849c8a4-12e7-4566-947d-698c58737956 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'security_group_rule': {'security_group_id': 'ffdab7b5-4d64-44ab-bdca-dfd461f30c9f', 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:51.886367 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1849c8a4-12e7-4566-947d-698c58737956 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.949309 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '337c87a7-17f3-4142-8ac8-7c86a74bcfa4', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'floating_ip_address': '172.27.3.215', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'port_id': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 530, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'mac_address': 'fa:16:3e:f2:ce:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:00:50Z', 'updated_at': '2021-11-12T15:00:50Z', 'revision_number': 0, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 5, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:00:51.949585 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b130902b-796e-47e6-9e99-fedce84fb452 req-b0f09874-9d69-4ca3-aa67-10c7ffdd458a service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0969822 Nov 12 15:00:51.952731 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1849c8a4-12e7-4566-947d-698c58737956 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.957289 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1849c8a4-12e7-4566-947d-698c58737956 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.973412 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1849c8a4-12e7-4566-947d-698c58737956 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd64e934-c630-4d3b-9e18-b1ff53cd29ff,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:51.982714 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de2203c8-1c2c-47b9-bb86-018b039bb126 None None] The sync data for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi is: [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '337c87a7-17f3-4142-8ac8-7c86a74bcfa4', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'floating_ip_address': '172.27.3.215', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'port_id': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 530, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'mac_address': 'fa:16:3e:f2:ce:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:00:50Z', 'updated_at': '2021-11-12T15:00:50Z', 'revision_number': 0, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 5, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:00:51.992610 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1849c8a4-12e7-4566-947d-698c58737956 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:51.993866 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-1849c8a4-12e7-4566-947d-698c58737956 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1405282 Nov 12 15:00:51.996706 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60768) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:52.001397 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-395c9a64-686c-4926-bbbb-feb3b1de5745 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'security_group_rule': {'security_group_id': 'ffdab7b5-4d64-44ab-bdca-dfd461f30c9f', 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:52.026942 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.securitygroups_db [None req-395c9a64-686c-4926-bbbb-feb3b1de5745 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Project 081b60b81cf04cd28b26a5b5cf5d5888 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 12 15:00:52.035310 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-395c9a64-686c-4926-bbbb-feb3b1de5745 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.094975 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3d0052cc-2d22-4eec-8f4e-a03a2fc17c3d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.111159 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-395c9a64-686c-4926-bbbb-feb3b1de5745 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.125573 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-395c9a64-686c-4926-bbbb-feb3b1de5745 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.149791 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-395c9a64-686c-4926-bbbb-feb3b1de5745 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6f712dc5-a640-44a1-aeef-1f29b7ab43fe,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:52.163727 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-395c9a64-686c-4926-bbbb-feb3b1de5745 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.165005 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-395c9a64-686c-4926-bbbb-feb3b1de5745 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1673307 Nov 12 15:00:52.168230 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 60770) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:00:52.172679 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-61bfce77-0998-4cd8-a669-f34a54ffce52 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'security_group_rule': {'security_group_id': 'ffdab7b5-4d64-44ab-bdca-dfd461f30c9f', 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:52.196892 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.securitygroups_db [None req-61bfce77-0998-4cd8-a669-f34a54ffce52 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Project 081b60b81cf04cd28b26a5b5cf5d5888 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 12 15:00:52.202397 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61bfce77-0998-4cd8-a669-f34a54ffce52 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.204533 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71a0086d-4fc6-410a-b398-7f99afe83f75 None None] New status for floating IP 337c87a7-17f3-4142-8ac8-7c86a74bcfa4: ACTIVE {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:00:52.271274 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61bfce77-0998-4cd8-a669-f34a54ffce52 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.276631 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61bfce77-0998-4cd8-a669-f34a54ffce52 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.303985 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61bfce77-0998-4cd8-a669-f34a54ffce52 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7812bc36-2015-49c6-a12c-f529b9cbeaf3,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:52.312087 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61bfce77-0998-4cd8-a669-f34a54ffce52 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.313946 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-61bfce77-0998-4cd8-a669-f34a54ffce52 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1444311 Nov 12 15:00:52.412042 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-bbbc2d67-fa2d-40f5-8c41-30866a98a52c tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1360662033&fields=id&tenant_id=081b60b81cf04cd28b26a5b5cf5d5888 HTTP/1.1" status: 200 len: 267 time: 0.0479579 Nov 12 15:00:52.472952 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-9694c8a4-5e9f-4911-8925-d70d58dd5be1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:52.474607 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-9694c8a4-5e9f-4911-8925-d70d58dd5be1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 945 time: 0.0567272 Nov 12 15:00:52.486100 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-94e9351b-cc65-492e-a300-743bda2791e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'port': {'security_groups': ['407a8ee7-48fd-4e47-a4e0-23203c0a793d', 'ffdab7b5-4d64-44ab-bdca-dfd461f30c9f']}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:52.551100 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-94e9351b-cc65-492e-a300-743bda2791e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.736458 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-94e9351b-cc65-492e-a300-743bda2791e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] For port 37ce8a4b-01d0-4c8c-8665-8f6627848b39, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:00:52.766225 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-94e9351b-cc65-492e-a300-743bda2791e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.771141 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-94e9351b-cc65-492e-a300-743bda2791e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.784181 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['37ce8a4b-01d0-4c8c-8665-8f6627848b39'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:00:52.819374 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-94e9351b-cc65-492e-a300-743bda2791e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:52.820009 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-94e9351b-cc65-492e-a300-743bda2791e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:52.821448 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d13386c7-7202-4cb0-a239-f74d2692c757 req-94e9351b-cc65-492e-a300-743bda2791e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "PUT /v2.0/ports/37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 981 time: 0.3401694 Nov 12 15:00:52.821903 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:52.824299 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7" -d '{"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:52.860952 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94e9351b-cc65-492e-a300-743bda2791e5 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'Port': ['ID=37ce8a4b-01d0-4c8c-8665-8f6627848b39,revision_number=6']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:52.893128 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3766a59-f6b7-447b-bde7-10ff123caf92 x-openstack-request-id: req-d3766a59-f6b7-447b-bde7-10ff123caf92 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:52.893419 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:52.894155 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-d3766a59-f6b7-447b-bde7-10ff123caf92 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:52.894670 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'status': 'completed', 'code': 200} Nov 12 15:00:52.918349 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['37ce8a4b-01d0-4c8c-8665-8f6627848b39'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:00:52.957375 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc79a226-dcd5-4fc4-844f-a5029316a4e1 req-6e2e4551-60a5-4296-a680-17621bcb6c40 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:52.960101 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cc79a226-dcd5-4fc4-844f-a5029316a4e1 req-6e2e4551-60a5-4296-a680-17621bcb6c40 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0588250 Nov 12 15:00:52.983527 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-bd43f2a0-dcb9-4f76-9888-a2c3bd1ff144 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:52.986031 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-bd43f2a0-dcb9-4f76-9888-a2c3bd1ff144 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1137 time: 0.0635285 Nov 12 15:00:53.035061 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cc79a226-dcd5-4fc4-844f-a5029316a4e1 req-0c42e7ac-247b-4fef-b525-6be0890a17fe tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0676451 Nov 12 15:00:53.099746 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-d5c3e487-80cd-4e82-9f30-71a30d665fc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:53.101261 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-d5c3e487-80cd-4e82-9f30-71a30d665fc6 service neutron] 10.222.0.86 "GET /v2.0/networks?id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 200 len: 915 time: 0.1075673 Nov 12 15:00:53.171993 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-ee98d21c-f495-41b7-9bdd-8485b6727b8a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 1001 time: 0.0629437 Nov 12 15:00:53.204815 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-a88b1254-f4bd-4a5a-8cd8-f0cc554e2eee None None] Provisioning complete for port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:53.205180 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-a88b1254-f4bd-4a5a-8cd8-f0cc554e2eee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:53.223226 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-6616d345-1bc9-4e0e-afd3-b6659e6440ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:53.224710 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-6616d345-1bc9-4e0e-afd3-b6659e6440ce service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 HTTP/1.1" status: 200 len: 853 time: 0.0449052 Nov 12 15:00:53.278106 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-563862ea-5765-4887-807d-f4eea3caed21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:53.279598 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-563862ea-5765-4887-807d-f4eea3caed21 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408924 Nov 12 15:00:53.336314 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:00:53.387032 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-902a5a0c-48fe-4e4a-a3c2-d7922d11ae49 service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0959966 Nov 12 15:00:53.487111 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5f8f8dbf-7498-4a7d-b26d-b132492d32f7 req-aafbf2f2-c80a-4342-a393-f37e3123fac5 service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889230 Nov 12 15:00:54.535424 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8345253e-fa7d-4d1d-8b4d-1d7de6e148e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:55.539154 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:55.571472 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-627d9257-c3f0-43bd-829f-da2d1ace76f5 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-409295797&fields=id&tenant_id=49070bd2a8b542b3801c73a224b4bba5 HTTP/1.1" status: 200 len: 267 time: 0.0494993 Nov 12 15:00:55.678001 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-291ea996-cdfa-4d56-a30b-6e9c6e8e87f4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:55.679570 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-291ea996-cdfa-4d56-a30b-6e9c6e8e87f4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/networks?id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b HTTP/1.1" status: 200 len: 809 time: 0.1012070 Nov 12 15:00:55.696759 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-6b10266f-d6e9-43f5-9492-b8af24d5c2ba tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/quotas/49070bd2a8b542b3801c73a224b4bba5 HTTP/1.1" status: 200 len: 375 time: 0.0099995 Nov 12 15:00:55.751205 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-9ab56227-610a-487f-ba4f-07d44fcb409f tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=49070bd2a8b542b3801c73a224b4bba5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0486097 Nov 12 15:00:55.902470 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-3b2b6e1b-e301-4c28-83a6-8ef76d517778 service neutron] 10.222.0.61 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1391821 Nov 12 15:00:55.996820 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-0e044af1-97bc-4db7-b878-40e3f6b2e9a8 service neutron] 10.222.0.61 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881491 Nov 12 15:00:56.304094 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-87344afc-b3b9-4695-aee3-acb9504930b3 req-fb99f27c-d635-4b9b-af0e-f596b78091d1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 210 time: 0.0359440 Nov 12 15:00:56.942253 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:57.342931 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-3ea75624-ec05-46fc-a20d-f4303c4487af tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:57.344493 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-3ea75624-ec05-46fc-a20d-f4303c4487af tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.86 "GET /v2.0/networks?id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b HTTP/1.1" status: 200 len: 809 time: 0.1109481 Nov 12 15:00:57.419028 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3450b18c-8f90-4710-aba4-c578cd1ac2eb req-72fceca4-c983-4f15-9734-0efa4c17a06a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 210 time: 0.0377436 Nov 12 15:00:57.449264 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-c3f111a8-a5ae-4306-b098-1f17000f97f0 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=49070bd2a8b542b3801c73a224b4bba5 HTTP/1.1" status: 200 len: 379 time: 0.0820444 Nov 12 15:00:57.463558 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Request body: {'port': {'device_id': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'admin_state_up': True, 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'security_groups': ['708da2d1-4d8f-46ad-af5e-34eafadae301']}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:57.572352 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Made reservation on behalf of 49070bd2a8b542b3801c73a224b4bba5 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:00:57.575906 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:57.702294 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Allocated IP 172.20.0.3 (ca05832f-5b12-4ac8-b78f-b968aa7e8f1b/0d076ecb-e243-4855-ace2-0ad087866ab5/ce38b191-8562-4891-b8f8-a8b58d423729) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:00:57.849269 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:57.883497 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:57.914252 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:57.927511 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:00:57.932735 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:00:57.936473 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:00:57.967236 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'Port': ['ID=ce38b191-8562-4891-b8f8-a8b58d423729,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:58.001630 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:58.002434 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:58.029897 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-a1796eb5-ddf4-4db4-87d6-854d87778132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5701122 Nov 12 15:00:58.048000 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Request body: {'port': {'device_id': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:00:58.108292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:58.239054 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-154ce49d-a11c-4ea0-a076-d7462e4a17c9 None None] Provisioning complete for port ce38b191-8562-4891-b8f8-a8b58d423729 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:00:58.240500 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-154ce49d-a11c-4ea0-a076-d7462e4a17c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:58.273518 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-154ce49d-a11c-4ea0-a076-d7462e4a17c9 None None] Port ce38b191-8562-4891-b8f8-a8b58d423729 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:00:58.382544 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ce38b191-8562-4891-b8f8-a8b58d423729 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:00:58.390338 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:58.403755 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Transition to ACTIVE for port object ce38b191-8562-4891-b8f8-a8b58d423729 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:00:58.407670 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:58.457820 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Pushing event updated for resources: {'Port': ['ID=ce38b191-8562-4891-b8f8-a8b58d423729,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:58.541377 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Attempting to bind port ce38b191-8562-4891-b8f8-a8b58d423729 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:00:58.541712 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Attempting to bind port ce38b191-8562-4891-b8f8-a8b58d423729 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:00:58.542037 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Attempting to bind port ce38b191-8562-4891-b8f8-a8b58d423729 on network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:58.547079 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Port ce38b191-8562-4891-b8f8-a8b58d423729 on network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:00:58.547627 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Attempting to bind port ce38b191-8562-4891-b8f8-a8b58d423729 on network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:00:58.554391 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 0, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:00:58.554838 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Checking segment: {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:00:58.555234 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Bound using segment: {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:00:58.555679 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Bound port: ce38b191-8562-4891-b8f8-a8b58d423729, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '01124735-d9c7-40e8-a61c-2a8529779c8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 623, 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:00:58.556088 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:58.562146 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4beb0e6a-3748-4ec3-b71a-b77e0be8b368 req-d2748a26-5b42-4852-aa52-f1addc2e9a12 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:58.562146 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4beb0e6a-3748-4ec3-b71a-b77e0be8b368 req-d2748a26-5b42-4852-aa52-f1addc2e9a12 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0623608 Nov 12 15:00:58.630349 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:00:58.633917 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ce38b191-8562-4891-b8f8-a8b58d423729,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:00:58.640754 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:58.648747 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4beb0e6a-3748-4ec3-b71a-b77e0be8b368 req-021c2e45-44b9-4897-8b1d-51b9549d3bc8 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0801232 Nov 12 15:00:58.679110 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:58.679754 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:00:58.681281 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] 10.222.0.86 "PUT /v2.0/ports/ce38b191-8562-4891-b8f8-a8b58d423729 HTTP/1.1" status: 200 len: 1093 time: 0.6398103 Nov 12 15:00:58.681691 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:00:58.683994 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2abcc612-c66a-452d-bc1b-1bd29e9a508d" -d '{"events": [{"name": "network-changed", "server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:00:58.712054 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adb86cdf-cc0b-44c4-baea-0ef2ca45557a service neutron] Pushing event updated for resources: {'Port': ['ID=ce38b191-8562-4891-b8f8-a8b58d423729,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:00:58.749836 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:00:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7fc1e49-1e31-482b-a0cb-7eeca9955754 x-openstack-request-id: req-b7fc1e49-1e31-482b-a0cb-7eeca9955754 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:00:58.750218 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:00:58.750579 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b7fc1e49-1e31-482b-a0cb-7eeca9955754 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:00:58.751048 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'status': 'completed', 'code': 200} Nov 12 15:00:58.797051 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-01591bf4-6f65-44f0-a103-d8af33fadd9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:58.798678 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-01591bf4-6f65-44f0-a103-d8af33fadd9b service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=49070bd2a8b542b3801c73a224b4bba5&device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1096 time: 0.0464332 Nov 12 15:00:58.851518 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-c57204a6-73ba-4cec-a5b6-d7c06ea2a28a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ce38b191-8562-4891-b8f8-a8b58d423729 HTTP/1.1" status: 200 len: 217 time: 0.0396261 Nov 12 15:00:58.907488 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-052eb2a3-744e-4c00-a200-70824c1c7751 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:58.909065 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-052eb2a3-744e-4c00-a200-70824c1c7751 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=0d076ecb-e243-4855-ace2-0ad087866ab5 HTTP/1.1" status: 200 len: 848 time: 0.0475354 Nov 12 15:00:58.967024 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-8448c07f-1af0-4ff4-a25a-62d2f1f4e70a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:58.968651 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-8448c07f-1af0-4ff4-a25a-62d2f1f4e70a service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0445406 Nov 12 15:00:59.080984 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-1314665c-5932-4dc8-bba3-3cb372863330 service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0999253 Nov 12 15:00:59.195450 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-888bbdba-80d9-43a4-807d-2d7ff6477d62 req-58051d65-2612-4eef-8408-78fcaadc1fd5 service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0989187 Nov 12 15:00:59.310607 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-7751090d-41d1-47c2-aa73-50ca4754e9c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:59.312131 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-7751090d-41d1-47c2-aa73-50ca4754e9c9 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=49070bd2a8b542b3801c73a224b4bba5&device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1096 time: 0.0475802 Nov 12 15:00:59.413739 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-7c902223-7d00-46ca-9dff-579e78c0235f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:59.415310 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-7c902223-7d00-46ca-9dff-579e78c0235f service neutron] 10.222.0.86 "GET /v2.0/networks?id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b HTTP/1.1" status: 200 len: 910 time: 0.0882456 Nov 12 15:00:59.472624 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-9fe19e76-988e-4647-860f-865b975fe5e6 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ce38b191-8562-4891-b8f8-a8b58d423729 HTTP/1.1" status: 200 len: 217 time: 0.0379400 Nov 12 15:00:59.526162 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-abbf227c-0c48-4f4a-b475-93ae6e99c583 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:59.527691 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-abbf227c-0c48-4f4a-b475-93ae6e99c583 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=0d076ecb-e243-4855-ace2-0ad087866ab5 HTTP/1.1" status: 200 len: 848 time: 0.0462260 Nov 12 15:00:59.576991 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-c50b5263-aa88-4516-8fff-fae1ff5187c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:59.578487 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-c50b5263-aa88-4516-8fff-fae1ff5187c5 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419800 Nov 12 15:00:59.680588 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-e0226c90-efa8-4a63-bd29-e521657e8e9e service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858438 Nov 12 15:00:59.773540 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd588aa9-0eb7-45c2-b9db-ebae2af56db0 req-f1596fbb-4883-4d7e-909c-12868f5920fc tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:00:59.774163 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2abcc612-c66a-452d-bc1b-1bd29e9a508d req-3ff42a4e-e0a1-495a-998c-544d1a19b849 service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848911 Nov 12 15:00:59.774983 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-bd588aa9-0eb7-45c2-b9db-ebae2af56db0 req-f1596fbb-4883-4d7e-909c-12868f5920fc tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0501113 Nov 12 15:00:59.831823 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-bd588aa9-0eb7-45c2-b9db-ebae2af56db0 req-7749ddfc-9388-420e-9cc5-cedf4d442ded tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0505428 Nov 12 15:01:00.952470 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-149172a7-aa94-402b-bd35-914849725905 req-79003dd6-7bfc-4967-9799-327f1cf39d86 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:00.953885 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-149172a7-aa94-402b-bd35-914849725905 req-79003dd6-7bfc-4967-9799-327f1cf39d86 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0496383 Nov 12 15:01:01.008098 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-149172a7-aa94-402b-bd35-914849725905 req-f073a383-44f6-4316-aeca-e039fd877abf tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481696 Nov 12 15:01:02.134968 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29e4c96-90d2-46a0-b06a-636c2fbcc959 req-eeac57e0-334f-4ede-87a4-ab99588dbbfc tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:02.136571 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a29e4c96-90d2-46a0-b06a-636c2fbcc959 req-eeac57e0-334f-4ede-87a4-ab99588dbbfc tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0538669 Nov 12 15:01:02.186659 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a29e4c96-90d2-46a0-b06a-636c2fbcc959 req-8ac83068-9180-47fc-a971-563a8746c6b2 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439501 Nov 12 15:01:03.306239 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967865b6-936e-4f3a-a3f9-9f9820a16a00 req-1544a596-3d22-4abc-966c-c3c08e8dd9ac tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:03.307778 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-967865b6-936e-4f3a-a3f9-9f9820a16a00 req-1544a596-3d22-4abc-966c-c3c08e8dd9ac tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0503588 Nov 12 15:01:03.357555 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-967865b6-936e-4f3a-a3f9-9f9820a16a00 req-467eac47-ce5e-4ef9-a502-b6f384d149e0 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439148 Nov 12 15:01:04.478472 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86dd9b1a-3db2-47d8-9a35-7cff2cafb31b req-5755405c-7215-44ba-858a-c691d5fcf686 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:04.479991 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-86dd9b1a-3db2-47d8-9a35-7cff2cafb31b req-5755405c-7215-44ba-858a-c691d5fcf686 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0491533 Nov 12 15:01:04.533016 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-86dd9b1a-3db2-47d8-9a35-7cff2cafb31b req-d8d8c038-fad5-4666-95a4-421b7303143b tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466881 Nov 12 15:01:04.976527 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:05.650580 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da737b88-7d38-4798-b3de-1c6ec53fb95e req-81c74e38-c79d-46ea-9276-87040b7dbb1e tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:05.652201 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-da737b88-7d38-4798-b3de-1c6ec53fb95e req-81c74e38-c79d-46ea-9276-87040b7dbb1e tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0514205 Nov 12 15:01:05.706055 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-da737b88-7d38-4798-b3de-1c6ec53fb95e req-1046c2fa-7014-40ca-88e9-3a4d87469822 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476513 Nov 12 15:01:06.573547 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ce38b191-8562-4891-b8f8-a8b58d423729 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:01:06.669046 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ce38b191-8562-4891-b8f8-a8b58d423729,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:01:06.679930 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'port_id': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'mac_address': 'fa:16:3e:5b:04:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 623, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:01:06.718612 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:06.735947 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ce38b191-8562-4891-b8f8-a8b58d423729 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:01:06.757332 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ce38b191-8562-4891-b8f8-a8b58d423729,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:01:06.766494 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:06.803093 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-dd842da6-441b-491d-a302-a2bee5f4825a service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0540211 Nov 12 15:01:06.825679 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=ce38b191-8562-4891-b8f8-a8b58d423729,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:01:06.856879 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d95b4ba-8baf-4634-b21a-028b160bc0a4 req-cffbd4e7-9d89-45ea-8509-50bc536455ee tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:06.858436 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9d95b4ba-8baf-4634-b21a-028b160bc0a4 req-cffbd4e7-9d89-45ea-8509-50bc536455ee tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 944 time: 0.0505495 Nov 12 15:01:06.915620 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9d95b4ba-8baf-4634-b21a-028b160bc0a4 req-72793316-8a1b-4a71-b77c-f911de0f8eb1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0505018 Nov 12 15:01:06.918095 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-138d2db1-2d3b-4970-bdd5-f7304c320032 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:06.919614 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-138d2db1-2d3b-4970-bdd5-f7304c320032 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 1098 time: 0.0432153 Nov 12 15:01:07.049112 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-edfdea9b-3afb-4621-b9ba-74507430a1a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:07.050558 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-edfdea9b-3afb-4621-b9ba-74507430a1a4 service neutron] 10.222.0.86 "GET /v2.0/networks?id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 200 len: 912 time: 0.0922611 Nov 12 15:01:07.093994 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['ce38b191-8562-4891-b8f8-a8b58d423729'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:01:07.131220 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-6a12021d-d86a-4214-9b55-b5bef2836a47 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=dd7d017f-a94d-4100-a980-fc29d066f333 HTTP/1.1" status: 200 len: 1001 time: 0.0582361 Nov 12 15:01:07.180795 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-75c1e2b7-d222-4f5f-a29c-e25967ca8cda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:07.182246 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-75c1e2b7-d222-4f5f-a29c-e25967ca8cda service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 200 len: 850 time: 0.0442574 Nov 12 15:01:07.235325 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-d4dd2951-c8a2-4314-9bb5-532ee64d8c85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:07.236866 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-d4dd2951-c8a2-4314-9bb5-532ee64d8c85 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=cf063ae4-6fb7-44b8-9c9f-984a39a87f66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430987 Nov 12 15:01:07.329783 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-3de00e69-298c-474d-a5e0-f7310c5b1144 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830426 Nov 12 15:01:07.657461 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-163d87e9-eb54-44ee-8f9c-a7269fca0cee req-761b5be5-5d7a-49b2-81a8-94cd5ba41712 service neutron] 10.222.0.86 "GET /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3198824 Nov 12 15:01:08.039419 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3352cd9d-22a5-41f8-b06c-2768c33f8e3e req-b976faf3-15ca-4b03-ae7f-6b18c3557bcf tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:08.040941 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3352cd9d-22a5-41f8-b06c-2768c33f8e3e req-b976faf3-15ca-4b03-ae7f-6b18c3557bcf tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 944 time: 0.0545070 Nov 12 15:01:08.094379 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3352cd9d-22a5-41f8-b06c-2768c33f8e3e req-2e67fa4e-b400-452b-91a9-05cf83457132 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473311 Nov 12 15:01:08.591510 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ce38b191-8562-4891-b8f8-a8b58d423729 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:01:08.640657 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port ce38b191-8562-4891-b8f8-a8b58d423729 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:01:08.644784 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port ce38b191-8562-4891-b8f8-a8b58d423729 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:01:08.645151 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:08.722211 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:08.744990 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:01:08.747086 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db2d1973-986c-4b5e-b10a-93d72d90c524" -d '{"events": [{"server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "name": "network-vif-plugged", "status": "completed", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:01:08.761487 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ce38b191-8562-4891-b8f8-a8b58d423729,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:01:08.769937 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:08.799435 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:01:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c7ad75a-17cf-4e84-b74a-c8b5371140ba x-openstack-request-id: req-4c7ad75a-17cf-4e84-b74a-c8b5371140ba {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:01:08.799785 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "name": "network-vif-plugged", "status": "completed", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:01:08.799979 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-4c7ad75a-17cf-4e84-b74a-c8b5371140ba {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:01:08.800395 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'code': 200} Nov 12 15:01:08.827794 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=ce38b191-8562-4891-b8f8-a8b58d423729,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:01:09.075263 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649c9ad3-88f7-4de8-8f41-2bd15e7d39f5 req-f498e657-45a8-43e1-9cfa-ea607c9668bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:09.076773 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-649c9ad3-88f7-4de8-8f41-2bd15e7d39f5 req-f498e657-45a8-43e1-9cfa-ea607c9668bb service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1098 time: 0.0422623 Nov 12 15:01:09.125450 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-649c9ad3-88f7-4de8-8f41-2bd15e7d39f5 req-81b7e5b7-7f3c-4504-bbb4-16f742fe9523 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389049 Nov 12 15:01:09.214766 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7547f5b7-83c6-4efd-bac7-e3fbad0fa842 req-db5dbd08-bc92-4495-ac61-9b8280c44931 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:09.216377 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7547f5b7-83c6-4efd-bac7-e3fbad0fa842 req-db5dbd08-bc92-4495-ac61-9b8280c44931 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0529225 Nov 12 15:01:09.267913 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7547f5b7-83c6-4efd-bac7-e3fbad0fa842 req-3c550dcc-80e4-41bd-895f-e1a6837eccef tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453377 Nov 12 15:01:10.391395 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33759f87-e60f-4348-b1e3-adeb1ae935e2 req-f16af575-e701-4ee7-b3fe-d0a4cc375727 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:10.392835 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-33759f87-e60f-4348-b1e3-adeb1ae935e2 req-f16af575-e701-4ee7-b3fe-d0a4cc375727 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0499563 Nov 12 15:01:10.447566 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-33759f87-e60f-4348-b1e3-adeb1ae935e2 req-61b4ff89-ecbf-490c-b24c-c394b36358da tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486321 Nov 12 15:01:11.572017 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d23b7b-7348-48c0-b06e-d7bc62c867a1 req-f2a2f039-b1ae-4435-b4b1-a51f0ef4a432 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:11.573594 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e2d23b7b-7348-48c0-b06e-d7bc62c867a1 req-f2a2f039-b1ae-4435-b4b1-a51f0ef4a432 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0502975 Nov 12 15:01:11.624766 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e2d23b7b-7348-48c0-b06e-d7bc62c867a1 req-9d97d8fe-2fa2-4bb5-a4c3-ec65c54f0e3e tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449960 Nov 12 15:01:11.743609 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d6677a9-364d-472f-bb1d-358683ddc3bf req-48da3b89-d970-41c9-bb4f-bfce5e07c298 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:11.745093 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4d6677a9-364d-472f-bb1d-358683ddc3bf req-48da3b89-d970-41c9-bb4f-bfce5e07c298 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0527706 Nov 12 15:01:11.795001 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4d6677a9-364d-472f-bb1d-358683ddc3bf req-dd80c12d-cf36-47e9-a612-51518304863b tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441198 Nov 12 15:01:11.816748 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60918) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:01:11.895905 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b11baa99-2e57-4341-a31d-8a37e7897dc6 tempest-TestShelveInstance-1149962719 tempest-TestShelveInstance-1149962719-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:11.897404 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b11baa99-2e57-4341-a31d-8a37e7897dc6 tempest-TestShelveInstance-1149962719 tempest-TestShelveInstance-1149962719-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1093 time: 0.0796754 Nov 12 15:01:11.900343 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 60922) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:01:11.904746 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Request body: {'floatingip': {'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'port_id': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'fixed_ip_address': '172.20.0.3'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:01:11.927117 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for floatingip, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:12.022637 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:12.125764 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Allocated IP 172.27.3.230 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/63aaba54-f83c-4d4c-bdce-92834993b9b4) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:01:12.231005 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:12.264129 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:12.300129 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:01:12.302884 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:01:12.308353 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:01:12.331304 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'Port': ['ID=63aaba54-f83c-4d4c-bdce-92834993b9b4,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:01:12.669620 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:12.742726 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:12.902234 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:12.906757 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:12.976856 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event updated for resources: {'Port': ['ID=63aaba54-f83c-4d4c-bdce-92834993b9b4,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:01:12.989292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:13.087110 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Floating IP 62085c6e-32e7-46ea-a10e-bdd797e42644 associated. External IP: 172.27.3.230, port: ce38b191-8562-4891-b8f8-a8b58d423729. Nov 12 15:01:13.286549 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:01:13.393261 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:01:13.403159 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] Sync routers for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:01:13.412630 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:13.414340 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:01:13.414974 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:01:13.439891 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-68a84b53-6a37-4741-89cd-1409c6fb3cfb tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5384960 Nov 12 15:01:13.440767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:01:13.442987 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-917e0256-eac8-4d88-8e7d-6c5686801654" -d '{"events": [{"name": "network-changed", "server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:01:13.480422 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:01:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-41b8e0be-77c3-4212-ac08-6c3a44f4ba68 x-openstack-request-id: req-41b8e0be-77c3-4212-ac08-6c3a44f4ba68 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:01:13.480715 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:01:13.480968 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-41b8e0be-77c3-4212-ac08-6c3a44f4ba68 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:01:13.481373 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'status': 'completed', 'code': 200} Nov 12 15:01:13.525771 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:01:13.560590 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-ca1cd241-9a9a-4aed-8ba9-1d679fa360d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:13.562138 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-ca1cd241-9a9a-4aed-8ba9-1d679fa360d4 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=49070bd2a8b542b3801c73a224b4bba5&device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1098 time: 0.0476980 Nov 12 15:01:13.654006 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-ddca276a-fe33-4bef-baae-d2a910d52920 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:13.655550 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-ddca276a-fe33-4bef-baae-d2a910d52920 service neutron] 10.222.0.86 "GET /v2.0/networks?id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b HTTP/1.1" status: 200 len: 910 time: 0.0851436 Nov 12 15:01:13.725823 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-32cc9c28-54fb-4e65-98fe-a0f62ac27742 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ce38b191-8562-4891-b8f8-a8b58d423729 HTTP/1.1" status: 200 len: 999 time: 0.0620508 Nov 12 15:01:13.754283 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '62085c6e-32e7-46ea-a10e-bdd797e42644', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'floating_ip_address': '172.27.3.230', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'port_id': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'mac_address': 'fa:16:3e:5b:04:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:01:12Z', 'updated_at': '2021-11-12T15:01:12Z', 'revision_number': 0, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:29Z', 'revision_number': 5, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:01:13.780629 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-ddb9ca8c-2a4d-4021-9575-0259cf563af5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:13.782103 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] Checking router: 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:01:13.783611 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-ddb9ca8c-2a4d-4021-9575-0259cf563af5 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=0d076ecb-e243-4855-ace2-0ad087866ab5 HTTP/1.1" status: 200 len: 848 time: 0.0493109 Nov 12 15:01:13.791895 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:01:13.792553 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:00:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:01:13.838998 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-0bc428fe-a06b-4dbd-a76f-264ee66b380e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:13.840442 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-0bc428fe-a06b-4dbd-a76f-264ee66b380e service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0468130 Nov 12 15:01:13.900558 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:01:13.951968 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-0684061d-0cc0-4870-bd0f-5ee1656cc6f1 service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860419 Nov 12 15:01:14.044272 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-917e0256-eac8-4d88-8e7d-6c5686801654 req-f115e107-8780-4bc2-a4b1-c74d17b293b6 service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848737 Nov 12 15:01:14.129644 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '62085c6e-32e7-46ea-a10e-bdd797e42644', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'floating_ip_address': '172.27.3.230', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'port_id': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'mac_address': 'fa:16:3e:5b:04:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:01:12Z', 'updated_at': '2021-11-12T15:01:12Z', 'revision_number': 0, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:29Z', 'revision_number': 5, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:01:14.156595 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24730c71-322d-439c-81a4-646f99ed3768 None None] The sync data for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi is: [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '62085c6e-32e7-46ea-a10e-bdd797e42644', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'floating_ip_address': '172.27.3.230', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'port_id': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 542, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'mac_address': 'fa:16:3e:5b:04:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:01:12Z', 'updated_at': '2021-11-12T15:01:12Z', 'revision_number': 0, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:29Z', 'revision_number': 5, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:01:14.351411 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86a0cc7f-ce55-4b5f-a23b-4531e4244b38 None None] New status for floating IP 62085c6e-32e7-46ea-a10e-bdd797e42644: ACTIVE {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:01:22.097605 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-79bfc137-316b-407b-9d4c-0edd4e64c088 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:24.540199 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f94f3bc7-2e19-457e-aa99-b6af6decb4f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:25.159667 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49461157-1698-4484-8dbc-03a191f8d962 req-31ab5611-36c2-4f2a-97d6-598e52d8cb44 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:25.161284 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-49461157-1698-4484-8dbc-03a191f8d962 req-31ab5611-36c2-4f2a-97d6-598e52d8cb44 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0493748 Nov 12 15:01:25.171903 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-21d1da9d-b2dc-485c-882d-dbc32226fb41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:25.173543 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-21d1da9d-b2dc-485c-882d-dbc32226fb41 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1137 time: 0.0461416 Nov 12 15:01:25.220745 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-49461157-1698-4484-8dbc-03a191f8d962 req-8a448d64-b30e-42fe-b652-a123add5a96d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0531292 Nov 12 15:01:25.277184 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-0ecd4334-29c7-4e96-b9c2-9609556abe3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:25.278750 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-0ecd4334-29c7-4e96-b9c2-9609556abe3a service neutron] 10.222.0.86 "GET /v2.0/networks?id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 200 len: 915 time: 0.0846467 Nov 12 15:01:25.352304 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-6ab08664-c61d-4631-8ea8-84845cbc980f service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 1001 time: 0.0617623 Nov 12 15:01:25.401770 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-61f2d1ea-b49f-4dad-a024-fc85b52f2b51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:25.403163 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-61f2d1ea-b49f-4dad-a024-fc85b52f2b51 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 HTTP/1.1" status: 200 len: 853 time: 0.0426276 Nov 12 15:01:25.448875 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-b63d6f16-51ea-471a-9f6b-4dae13758c77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:25.450323 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-b63d6f16-51ea-471a-9f6b-4dae13758c77 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0395117 Nov 12 15:01:25.540695 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:25.555484 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-47bd474b-c30f-4379-9ac3-c9c40a0ef72f service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0954597 Nov 12 15:01:25.666580 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-631c0989-2dea-4846-8d87-ee9c86c15acf req-52bfc950-5980-4180-b9d4-d4e2a4d6cfb2 service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883412 Nov 12 15:01:26.344887 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0bb459-283f-4c2b-aa6b-00859062c839 req-e2d82f74-904c-44c2-a61f-1c1b8c741410 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:26.346355 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8e0bb459-283f-4c2b-aa6b-00859062c839 req-e2d82f74-904c-44c2-a61f-1c1b8c741410 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0500863 Nov 12 15:01:26.409613 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8e0bb459-283f-4c2b-aa6b-00859062c839 req-be5868fa-557a-4b4b-be9a-1b1f4b37fb17 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0573070 Nov 12 15:01:26.942954 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:27.558844 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37572f6d-a476-4d12-92f6-46dc95ddb141 req-da5eab35-ec7a-4c1e-8f1f-d196ce16f3fa tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:27.560353 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-37572f6d-a476-4d12-92f6-46dc95ddb141 req-da5eab35-ec7a-4c1e-8f1f-d196ce16f3fa tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0685737 Nov 12 15:01:27.626310 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-37572f6d-a476-4d12-92f6-46dc95ddb141 req-c812740c-7ab9-4b9e-81ec-891c4292e66b tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0592809 Nov 12 15:01:27.917866 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:28.744916 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9111b775-5e58-4bb5-9416-26b74ebe2ea7 req-09f2fae5-f0ba-466f-b320-426c6ada46f4 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:28.746381 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9111b775-5e58-4bb5-9416-26b74ebe2ea7 req-09f2fae5-f0ba-466f-b320-426c6ada46f4 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0494082 Nov 12 15:01:28.808066 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9111b775-5e58-4bb5-9416-26b74ebe2ea7 req-73b0b080-f616-44e5-9136-d501eea6b8ac tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0557988 Nov 12 15:01:29.923694 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06afd36f-4997-433d-a048-6054d07d14aa req-56b8e0d5-1fe0-4034-b55f-9d4f33edd16a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:29.925746 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-06afd36f-4997-433d-a048-6054d07d14aa req-56b8e0d5-1fe0-4034-b55f-9d4f33edd16a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0490112 Nov 12 15:01:29.984235 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-06afd36f-4997-433d-a048-6054d07d14aa req-8010b805-750f-40cc-adfc-c923913625fc tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0525632 Nov 12 15:01:30.335519 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:01:31.104034 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe30dd36-985b-45ed-b3ab-b86b77f3375d req-5839f473-038b-4a8b-b868-3cf74b048327 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:31.105591 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fe30dd36-985b-45ed-b3ab-b86b77f3375d req-5839f473-038b-4a8b-b868-3cf74b048327 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0495772 Nov 12 15:01:31.168825 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fe30dd36-985b-45ed-b3ab-b86b77f3375d req-ca17e16d-4eab-4b44-87fe-65c804dc5a9f tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0568933 Nov 12 15:01:32.292602 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ba178e-4d62-42b3-88b5-652db2a65208 req-5fe2ef52-f0f0-45b1-869c-b86cc6834c68 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:32.294142 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-41ba178e-4d62-42b3-88b5-652db2a65208 req-5fe2ef52-f0f0-45b1-869c-b86cc6834c68 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0535896 Nov 12 15:01:32.361372 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-41ba178e-4d62-42b3-88b5-652db2a65208 req-b07dfeb0-0fd4-400e-ba3b-514bbbf2a6ab tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0606654 Nov 12 15:01:33.484064 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b813bb93-ce48-42d3-ba67-e272f469b0dc req-49f5084a-cd36-4637-b3d6-888afec0b0b9 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:33.485474 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b813bb93-ce48-42d3-ba67-e272f469b0dc req-49f5084a-cd36-4637-b3d6-888afec0b0b9 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0527613 Nov 12 15:01:33.547378 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b813bb93-ce48-42d3-ba67-e272f469b0dc req-145a6f7f-54aa-4e7f-a687-c31d29e53024 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0555673 Nov 12 15:01:34.666788 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed83a1f2-a2f1-4058-8142-dbfdb5a35fef req-c704358d-10aa-4dab-a044-d960d3ae04e7 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:34.668307 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ed83a1f2-a2f1-4058-8142-dbfdb5a35fef req-c704358d-10aa-4dab-a044-d960d3ae04e7 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0520632 Nov 12 15:01:34.735516 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ed83a1f2-a2f1-4058-8142-dbfdb5a35fef req-a26ea213-4b31-4dd2-a8ec-4244405cc19d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0605071 Nov 12 15:01:34.976173 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:35.858570 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f487df-9d5a-4c8f-b692-3415ef11810f req-aec77bda-8d66-4be4-ba6c-79168067187d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:35.860024 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-59f487df-9d5a-4c8f-b692-3415ef11810f req-aec77bda-8d66-4be4-ba6c-79168067187d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0540986 Nov 12 15:01:35.920884 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-59f487df-9d5a-4c8f-b692-3415ef11810f req-c4f5e6b5-0445-4d1c-91d2-23040fa40435 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0540998 Nov 12 15:01:37.043867 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb5fbd44-ad8c-4fa6-81f0-bd5573856c5a req-e081d006-e3c1-405f-bc41-ba6d5d054b08 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:37.045394 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fb5fbd44-ad8c-4fa6-81f0-bd5573856c5a req-e081d006-e3c1-405f-bc41-ba6d5d054b08 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0525451 Nov 12 15:01:37.113646 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fb5fbd44-ad8c-4fa6-81f0-bd5573856c5a req-80c9acdc-754e-4677-8ca6-c2feeff97e9a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0609217 Nov 12 15:01:37.296703 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35af1c86-aa8e-46e0-bf55-6d7e2e2b62a4 req-3b0f76e5-a44c-4300-8dee-8c3898cc0832 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:37.298197 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35af1c86-aa8e-46e0-bf55-6d7e2e2b62a4 req-3b0f76e5-a44c-4300-8dee-8c3898cc0832 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0509830 Nov 12 15:01:37.349989 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35af1c86-aa8e-46e0-bf55-6d7e2e2b62a4 req-049191ee-4722-4298-b48a-989668eb550c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0452845 Nov 12 15:01:38.236657 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425bbbe-6c30-4ca2-8a8f-9d7c72d5410b req-427bf54a-a0d7-4dcf-91a0-e32c5799d9b8 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:38.238879 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f425bbbe-6c30-4ca2-8a8f-9d7c72d5410b req-427bf54a-a0d7-4dcf-91a0-e32c5799d9b8 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0516689 Nov 12 15:01:38.318529 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f425bbbe-6c30-4ca2-8a8f-9d7c72d5410b req-cdeb3bc5-37e3-4253-bea3-1ae86cabbcc7 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0735636 Nov 12 15:01:38.474638 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-226e3484-8123-47ae-873b-aead35ef2106 req-2b7468da-b596-4f7b-8048-59f8cdfaa69b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:38.476135 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-226e3484-8123-47ae-873b-aead35ef2106 req-2b7468da-b596-4f7b-8048-59f8cdfaa69b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0505195 Nov 12 15:01:38.530599 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-226e3484-8123-47ae-873b-aead35ef2106 req-1c6e00c8-1179-4386-af55-234c6305bd58 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0468566 Nov 12 15:01:39.441086 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29544145-d8b7-4564-adc9-8e5259bee656 req-d746b03d-2919-4f8b-9d73-4fd3002444ea tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:39.442697 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-29544145-d8b7-4564-adc9-8e5259bee656 req-d746b03d-2919-4f8b-9d73-4fd3002444ea tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0535402 Nov 12 15:01:39.519309 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-29544145-d8b7-4564-adc9-8e5259bee656 req-2608002b-2b85-416a-ac03-6b0aac04bd01 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0698140 Nov 12 15:01:39.669493 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31fdeec3-e6ed-43c6-ae0d-322e61ce09c4 req-0e708664-688f-4e4e-9c42-7732ee4a7a4f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:39.672141 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-31fdeec3-e6ed-43c6-ae0d-322e61ce09c4 req-0e708664-688f-4e4e-9c42-7732ee4a7a4f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0685012 Nov 12 15:01:39.724757 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-31fdeec3-e6ed-43c6-ae0d-322e61ce09c4 req-1d755f44-6e9f-498f-a131-dd84d75b377a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0456960 Nov 12 15:01:40.639276 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48a18fa0-16f4-428e-9e0c-055a393348a4 req-a0cbd087-01e3-4132-a213-bbb1ca1a04b9 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:40.641145 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-48a18fa0-16f4-428e-9e0c-055a393348a4 req-a0cbd087-01e3-4132-a213-bbb1ca1a04b9 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0529270 Nov 12 15:01:40.703801 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-48a18fa0-16f4-428e-9e0c-055a393348a4 req-ffc67379-2eaa-40d4-962b-97c9d0aaef8d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0560205 Nov 12 15:01:40.856268 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dacb7c31-01a1-4e03-87cb-b011a84564c7 req-98d53c8e-ba23-4280-aa1d-3d98de0e5b64 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:40.857868 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dacb7c31-01a1-4e03-87cb-b011a84564c7 req-98d53c8e-ba23-4280-aa1d-3d98de0e5b64 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0575056 Nov 12 15:01:40.911613 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dacb7c31-01a1-4e03-87cb-b011a84564c7 req-4d6ae59e-3ce3-4b3c-bd38-dcc09c3b32b5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0474315 Nov 12 15:01:41.844009 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a32d43b1-2874-4ee6-9c95-789a77d1d26a req-9642aa76-bf12-494e-8314-603a85ec22dc tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:41.845569 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a32d43b1-2874-4ee6-9c95-789a77d1d26a req-9642aa76-bf12-494e-8314-603a85ec22dc tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0530970 Nov 12 15:01:41.913918 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a32d43b1-2874-4ee6-9c95-789a77d1d26a req-f5026d4c-d8e8-4816-8b5c-babb1ce841e8 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0614226 Nov 12 15:01:42.046615 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3419877-e3de-4a8e-b8e3-1e3ceac39bb2 req-f2da867c-191c-4c14-a7e3-f1a52c2bb2d2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:42.048248 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d3419877-e3de-4a8e-b8e3-1e3ceac39bb2 req-f2da867c-191c-4c14-a7e3-f1a52c2bb2d2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0585930 Nov 12 15:01:42.099963 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d3419877-e3de-4a8e-b8e3-1e3ceac39bb2 req-eb8243af-c840-4d27-bbbb-b3671058ead6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0451100 Nov 12 15:01:43.049677 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-350d3142-db75-4a79-be44-bfa18d31f75b req-5fd68c61-62f0-4ef8-95ce-6ec7d457bd79 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:43.051292 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-350d3142-db75-4a79-be44-bfa18d31f75b req-5fd68c61-62f0-4ef8-95ce-6ec7d457bd79 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0653007 Nov 12 15:01:43.140158 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-350d3142-db75-4a79-be44-bfa18d31f75b req-1f17b9f7-28d9-40b2-942b-6b4e2d30bd02 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0814831 Nov 12 15:01:43.230928 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc39d15-3293-43e2-938c-5ca461744ada req-e0c1b365-1f33-4fb9-add6-b7b00b84011a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:43.232493 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ccc39d15-3293-43e2-938c-5ca461744ada req-e0c1b365-1f33-4fb9-add6-b7b00b84011a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0514321 Nov 12 15:01:43.286348 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ccc39d15-3293-43e2-938c-5ca461744ada req-1b5767bd-305f-4361-be09-be7f5a7a1c53 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0460513 Nov 12 15:01:44.263642 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57164e0a-084f-4411-b6b4-a0ff0332b7a1 req-981b7c1f-dd11-4bdf-b717-a27e19e74f77 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:44.265620 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-57164e0a-084f-4411-b6b4-a0ff0332b7a1 req-981b7c1f-dd11-4bdf-b717-a27e19e74f77 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0535581 Nov 12 15:01:44.337232 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-57164e0a-084f-4411-b6b4-a0ff0332b7a1 req-40ba3ae1-21b3-4df9-84c1-b161a3c0fbe1 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0640116 Nov 12 15:01:44.467358 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f60e23f-084d-4b90-ba33-98ad82e73eaf req-149b78f9-f1c3-44db-9710-da68a500d8c1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:44.470131 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3f60e23f-084d-4b90-ba33-98ad82e73eaf req-149b78f9-f1c3-44db-9710-da68a500d8c1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0708237 Nov 12 15:01:44.536631 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3f60e23f-084d-4b90-ba33-98ad82e73eaf req-c18df7d1-19e2-4478-8ec9-ae38d8913e33 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0537899 Nov 12 15:01:45.475166 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d641e5d2-8008-42de-8c18-7f4fabf0ebd6 req-1a47c7d9-e8b2-40d5-bc1c-7a59441d6afd tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:45.477359 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d641e5d2-8008-42de-8c18-7f4fabf0ebd6 req-1a47c7d9-e8b2-40d5-bc1c-7a59441d6afd tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0634975 Nov 12 15:01:45.546717 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d641e5d2-8008-42de-8c18-7f4fabf0ebd6 req-48134c92-c7e2-4ebe-9dbf-157a3b920ec4 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0631096 Nov 12 15:01:45.691613 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-161199c1-821f-472a-bd28-3771336e2ec6 req-3776183d-b4b6-4c8a-9872-f216889a0733 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:45.694315 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-161199c1-821f-472a-bd28-3771336e2ec6 req-3776183d-b4b6-4c8a-9872-f216889a0733 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0628417 Nov 12 15:01:45.749635 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-161199c1-821f-472a-bd28-3771336e2ec6 req-94cfe42b-05ec-4b11-b000-2d5336c1231e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0494034 Nov 12 15:01:46.667602 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea99e3e4-0240-402f-931e-c1ad4f7c116c req-ceba203e-eed4-4c6f-a2cf-583798eebdeb tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:46.669180 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea99e3e4-0240-402f-931e-c1ad4f7c116c req-ceba203e-eed4-4c6f-a2cf-583798eebdeb tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0552280 Nov 12 15:01:46.744663 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea99e3e4-0240-402f-931e-c1ad4f7c116c req-90e08625-bb61-455b-8b5b-67f6317bb138 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0679154 Nov 12 15:01:46.874686 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7ccda20-afd9-4d9d-a85d-c04190103fef req-9caeacb8-94c5-495f-acee-ac6d14fd2aba tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:46.876100 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f7ccda20-afd9-4d9d-a85d-c04190103fef req-9caeacb8-94c5-495f-acee-ac6d14fd2aba tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0507691 Nov 12 15:01:46.928852 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f7ccda20-afd9-4d9d-a85d-c04190103fef req-7681fdbd-8fb4-41c5-b4b3-59da61b803e9 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0443902 Nov 12 15:01:47.866297 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91ef88aa-c8c9-4b67-bf9c-e3a9a3130689 req-00ea1cd7-851c-446e-861a-8af90480e5ee tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:47.867849 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-91ef88aa-c8c9-4b67-bf9c-e3a9a3130689 req-00ea1cd7-851c-446e-861a-8af90480e5ee tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0535812 Nov 12 15:01:47.931976 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-91ef88aa-c8c9-4b67-bf9c-e3a9a3130689 req-3739784e-2d60-49da-903d-e0bf62128248 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f&id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0577998 Nov 12 15:01:48.073766 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979f3865-736f-455d-a2b4-d87d7364ac26 req-18d9662c-a66e-4498-bbdf-80e1b2cc7b64 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:48.075358 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-979f3865-736f-455d-a2b4-d87d7364ac26 req-18d9662c-a66e-4498-bbdf-80e1b2cc7b64 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0642161 Nov 12 15:01:48.127436 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-979f3865-736f-455d-a2b4-d87d7364ac26 req-84162fe9-7591-4d8f-9e80-96c2ad9b057c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0442317 Nov 12 15:01:49.250952 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e1135bf-77a3-4444-a469-2d92b5e18b68 req-cb916d50-9dc5-4dd7-9b4b-f309c3561922 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:49.252577 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3e1135bf-77a3-4444-a469-2d92b5e18b68 req-cb916d50-9dc5-4dd7-9b4b-f309c3561922 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0509222 Nov 12 15:01:49.303815 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3e1135bf-77a3-4444-a469-2d92b5e18b68 req-c315e90f-8847-465f-a59d-88b66fea4dab tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0451221 Nov 12 15:01:50.427929 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00a8fdb-ce9b-4a71-946f-3de6d6e70f07 req-1f340f5a-06bd-4c1c-a9b5-86ea0f240acd tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:50.429467 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e00a8fdb-ce9b-4a71-946f-3de6d6e70f07 req-1f340f5a-06bd-4c1c-a9b5-86ea0f240acd tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0481181 Nov 12 15:01:50.475052 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e00a8fdb-ce9b-4a71-946f-3de6d6e70f07 req-f916466a-6649-4a8a-a8b2-8bb105a1b7ed tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0396831 Nov 12 15:01:51.600232 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84fea506-c0d9-49ab-af93-57b78ab9be5a req-374a0818-935d-4b58-84a2-bd55fb57b03a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:51.601703 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-84fea506-c0d9-49ab-af93-57b78ab9be5a req-374a0818-935d-4b58-84a2-bd55fb57b03a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0520115 Nov 12 15:01:51.649066 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-84fea506-c0d9-49ab-af93-57b78ab9be5a req-fdad3e2f-abda-4a7a-a3bf-2b2493baf01a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0415115 Nov 12 15:01:52.099608 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-db9adc65-7a03-4335-b2b9-816d0857643d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:52.771610 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605a5722-efae-4bdb-b6a6-7dbc5fccbe7c req-abcefe4f-6694-4151-9ad3-5c5bef14ab37 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:52.773188 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-605a5722-efae-4bdb-b6a6-7dbc5fccbe7c req-abcefe4f-6694-4151-9ad3-5c5bef14ab37 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0521195 Nov 12 15:01:52.824591 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-605a5722-efae-4bdb-b6a6-7dbc5fccbe7c req-f96e026b-ca48-4855-aff9-f73b6e5e1396 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0453711 Nov 12 15:01:53.954008 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecfefb5d-9f8c-4870-9231-e1ccb7f61738 req-684f5779-5977-44bd-9200-7c1dad49002e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:53.955484 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ecfefb5d-9f8c-4870-9231-e1ccb7f61738 req-684f5779-5977-44bd-9200-7c1dad49002e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0516815 Nov 12 15:01:54.003635 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ecfefb5d-9f8c-4870-9231-e1ccb7f61738 req-896bbd9e-6ed7-4587-9340-67097ea1e863 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0415699 Nov 12 15:01:54.541718 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8842eaf2-aecb-4d3c-a600-f53716a84f6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:54.780604 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:01:54.884538 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:01:54.897143 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'port_id': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'mac_address': 'fa:16:3e:50:13:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 638, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:01:54.935167 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:54.947827 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id b0bd777f-598e-4de7-ab20-79ef7b06cdac {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:01:54.967604 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:01:54.971389 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:55.017398 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=6']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:01:55.024845 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.025175 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.025514 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.025849 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.026415 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.026755 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.027085 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.027411 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.027737 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.028066 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.028407 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.028723 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:55.122767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57907b02-d61a-4d2a-b893-c7440427c561 req-de36620c-4af0-406b-a834-692568ba1a3d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:55.124141 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-57907b02-d61a-4d2a-b893-c7440427c561 req-de36620c-4af0-406b-a834-692568ba1a3d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 945 time: 0.0487921 Nov 12 15:01:55.150604 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['b0bd777f-598e-4de7-ab20-79ef7b06cdac'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:01:55.177643 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-57907b02-d61a-4d2a-b893-c7440427c561 req-6f0e2dae-a85b-4d98-879d-75ea5351d057 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0465550 Nov 12 15:01:55.542086 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:56.322613 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1db8fd0-9d05-44e2-850d-c093f3fc7df5 req-e6685d05-2bd4-4992-b825-17db8b8743d9 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:56.331582 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a1db8fd0-9d05-44e2-850d-c093f3fc7df5 req-e6685d05-2bd4-4992-b825-17db8b8743d9 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 945 time: 0.0722878 Nov 12 15:01:56.394519 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a1db8fd0-9d05-44e2-850d-c093f3fc7df5 req-c77f4fcb-b676-43d9-b8a8-cd86827ce472 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0613439 Nov 12 15:01:56.568279 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a3d44ff-c767-4cca-ad8c-3b287c192b36 req-49690326-aee2-4d70-b108-7afe18363197 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:56.570064 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3a3d44ff-c767-4cca-ad8c-3b287c192b36 req-49690326-aee2-4d70-b108-7afe18363197 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 945 time: 0.0651970 Nov 12 15:01:56.669487 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3a3d44ff-c767-4cca-ad8c-3b287c192b36 req-d1108f4b-0541-4c91-8b60-920583f29df7 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0869622 Nov 12 15:01:56.791972 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:01:56.854597 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port b0bd777f-598e-4de7-ab20-79ef7b06cdac triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:01:56.855218 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:56.958423 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:56.962064 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:56.987463 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:01:56.990693 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f784f4eb-e7ea-43c3-baee-ff3072d06c9d" -d '{"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-plugged", "status": "completed", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:01:57.005288 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:01:57.015189 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:57.057422 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:01:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9de0bc04-9452-4b14-8930-7effd63c46b0 x-openstack-request-id: req-9de0bc04-9452-4b14-8930-7effd63c46b0 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:01:57.057710 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-plugged", "status": "completed", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:01:57.057966 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-9de0bc04-9452-4b14-8930-7effd63c46b0 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:01:57.058336 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'code': 200} Nov 12 15:01:57.094825 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=7']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:01:57.522162 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e346fc-f576-4f69-88b5-79db7b288667 req-800899ed-d13d-407e-a795-a4f8de9d9b34 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:57.528398 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b0e346fc-f576-4f69-88b5-79db7b288667 req-800899ed-d13d-407e-a795-a4f8de9d9b34 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0580621 Nov 12 15:01:57.594199 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b0e346fc-f576-4f69-88b5-79db7b288667 req-baae916f-9e9e-4b7a-a07f-7b7cbade0673 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0611312 Nov 12 15:01:57.930386 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:58.130208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97603d52-4cb7-4c0b-88f3-3cf82307ea46 req-e00cf9b2-4135-4da2-86dc-ea08cd2c936b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:58.138347 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97603d52-4cb7-4c0b-88f3-3cf82307ea46 req-e00cf9b2-4135-4da2-86dc-ea08cd2c936b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 945 time: 0.3733897 Nov 12 15:01:58.210211 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97603d52-4cb7-4c0b-88f3-3cf82307ea46 req-ac014154-5831-4147-a1fb-74feab71412a tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0709293 Nov 12 15:01:58.751416 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c4ae27-ebfe-4ac1-be0e-6740243df413 req-d25fbcbb-aa10-4ec0-8ac3-060f93fcf8e5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:58.751416 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-87c4ae27-ebfe-4ac1-be0e-6740243df413 req-d25fbcbb-aa10-4ec0-8ac3-060f93fcf8e5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0608792 Nov 12 15:01:58.818177 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-87c4ae27-ebfe-4ac1-be0e-6740243df413 req-09232fb4-2a17-46d6-a4e6-e616ff42a42e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0603502 Nov 12 15:01:58.892767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-b178d5a7-40e7-4f29-bcaa-1c936b0003b1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:58.894901 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-b178d5a7-40e7-4f29-bcaa-1c936b0003b1 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 945 time: 0.0567527 Nov 12 15:01:59.014196 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Deleting port dd7d017f-a94d-4100-a980-fc29d066f333 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:01:59.014611 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:59.125773 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] For port dd7d017f-a94d-4100-a980-fc29d066f333, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=dd7d017f-a94d-4100-a980-fc29d066f333,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:01:59.126144 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:59.360239 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:59.360962 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:59.360962 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Floating IP ba5a13eb-50e3-4e0f-8f17-d9a263efde9f disassociated. External IP: 172.27.3.179, port: dd7d017f-a94d-4100-a980-fc29d066f333. Nov 12 15:01:59.361221 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Calling delete_port for dd7d017f-a94d-4100-a980-fc29d066f333 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:01:59.391545 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c12f9a4-1bfb-409a-bb80-fce658b3ec3d req-dd62267f-1a96-43dc-9f1a-ff850ab7be9b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:01:59.393684 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9c12f9a4-1bfb-409a-bb80-fce658b3ec3d req-dd62267f-1a96-43dc-9f1a-ff850ab7be9b tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 945 time: 0.0744689 Nov 12 15:01:59.484569 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9c12f9a4-1bfb-409a-bb80-fce658b3ec3d req-8b45b7b8-5054-4ee7-8d94-182e6ed12695 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups?id=79e7e172-0c31-44bf-9a13-0d36bf1eec5e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0618429 Nov 12 15:01:59.583432 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:59.611654 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event deleted for resources: {'Port': ['ID=dd7d017f-a94d-4100-a980-fc29d066f333,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:01:59.624372 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.624727 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.625073 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.625419 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.625751 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.626083 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.626413 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.626776 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.627064 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.628853 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.628853 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.628853 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:01:59.751592 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Router a08d9f45-c652-4276-867c-ab77c8f81aef has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:01:59.881556 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:01:59.897571 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] Sync routers for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:01:59.918834 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:01:59.919482 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:01:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:01:59.926763 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] No DVR routers for this DVR port dd7d017f-a94d-4100-a980-fc29d066f333 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:01:59.930464 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:01:59.935960 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-958fbe92-1680-4f84-b2c6-144c6ee97c58 req-2780aa17-a554-443b-87f8-ec4be40a72d6 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.86 "DELETE /v2.0/ports/dd7d017f-a94d-4100-a980-fc29d066f333 HTTP/1.1" status: 204 len: 173 time: 1.0327799 Nov 12 15:01:59.937851 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'name': 'network-vif-deleted', 'tag': 'dd7d017f-a94d-4100-a980-fc29d066f333'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:01:59.942480 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e76dcb5-f213-4e93-ae36-9a50f9b9be7f" -d '{"events": [{"server_uuid": "4890b09a-fc1a-4d2a-89bf-35b5c775d762", "name": "network-vif-deleted", "tag": "dd7d017f-a94d-4100-a980-fc29d066f333"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:00.010966 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:01:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c8ca8a5-09b5-4e15-9a3d-a0a437e95926 x-openstack-request-id: req-5c8ca8a5-09b5-4e15-9a3d-a0a437e95926 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:00.011257 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4890b09a-fc1a-4d2a-89bf-35b5c775d762", "name": "network-vif-deleted", "tag": "dd7d017f-a94d-4100-a980-fc29d066f333", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:00.011585 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-5c8ca8a5-09b5-4e15-9a3d-a0a437e95926 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:00.011921 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4890b09a-fc1a-4d2a-89bf-35b5c775d762', 'name': 'network-vif-deleted', 'tag': 'dd7d017f-a94d-4100-a980-fc29d066f333', 'status': 'completed', 'code': 200} Nov 12 15:02:00.274306 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:00.324059 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc6e153a-6e8f-4972-808a-ccab62eb2dde req-e7922170-482a-4ae5-9800-3fde20f6d108 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:00.331879 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-dc6e153a-6e8f-4972-808a-ccab62eb2dde req-e7922170-482a-4ae5-9800-3fde20f6d108 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.4195089 Nov 12 15:02:00.394001 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-dc6e153a-6e8f-4972-808a-ccab62eb2dde req-6d605673-4f4c-49aa-9842-b678363563be tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0601780 Nov 12 15:02:00.543853 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:00.601906 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] Checking router: a08d9f45-c652-4276-867c-ab77c8f81aef for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:02:00.624813 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:00.625529 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:01:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:00.683593 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07518729-feb1-42b0-9670-9b5e2cc0696c req-1c14c933-9726-430a-b513-ee2302bbfe3e tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/ports?device_id=4890b09a-fc1a-4d2a-89bf-35b5c775d762 HTTP/1.1" status: 200 len: 210 time: 0.0477145 Nov 12 15:02:00.795223 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:01.051988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:01.080560 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6f921d2-b477-40a4-ba06-6cc37c7b84b7 None None] The sync data for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi is: [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T14:55:04Z', 'revision_number': 4, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'ceb62b38-4fa2-461d-8699-99ddeedd36fb', 'name': '', 'network_id': 'cf063ae4-6fb7-44b8-9c9f-984a39a87f66', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'mac_address': 'fa:16:3e:7a:26:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:55:03Z', 'updated_at': '2021-11-12T14:55:13Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'subnets': [{'id': 'f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:02:01.354178 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97193b92-59a1-4b63-9330-98f18c72bf60 None None] New status for floating IP ba5a13eb-50e3-4e0f-8f17-d9a263efde9f: DOWN {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:02:01.563252 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2656d8b8-cbf4-466a-a6ac-ea1bae2a6180 req-7f271531-973c-4841-9bde-4a4de65c8af1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:01.566043 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2656d8b8-cbf4-466a-a6ac-ea1bae2a6180 req-7f271531-973c-4841-9bde-4a4de65c8af1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0751688 Nov 12 15:02:01.627228 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2656d8b8-cbf4-466a-a6ac-ea1bae2a6180 req-0a7bda85-31f1-4a2c-b16e-84865ce5491e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0542262 Nov 12 15:02:01.784297 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33078) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:01.853411 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-25afe666-3dc4-47cb-8e14-ef575ae75a7d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:01.882273 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-25afe666-3dc4-47cb-8e14-ef575ae75a7d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:01.941025 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-25afe666-3dc4-47cb-8e14-ef575ae75a7d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:01.944140 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-25afe666-3dc4-47cb-8e14-ef575ae75a7d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:01.945600 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-25afe666-3dc4-47cb-8e14-ef575ae75a7d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "DELETE /v2.0/security-groups/79e7e172-0c31-44bf-9a13-0d36bf1eec5e HTTP/1.1" status: 204 len: 168 time: 0.1598859 Nov 12 15:02:01.949054 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33080) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:01.960946 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25afe666-3dc4-47cb-8e14-ef575ae75a7d tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=79e7e172-0c31-44bf-9a13-0d36bf1eec5e,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:01.979500 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.api.v2.resource [None req-6de778df-a442-4888-b6c6-70326cbd5663 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] show failed (client error): The resource could not be found. Nov 12 15:02:01.980784 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-6de778df-a442-4888-b6c6-70326cbd5663 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "GET /v2.0/security-groups/79e7e172-0c31-44bf-9a13-0d36bf1eec5e HTTP/1.1" status: 404 len: 347 time: 0.0298841 Nov 12 15:02:01.983698 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33082) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:02.133829 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Deleting port 744fb487-5ec9-46c5-aff9-8b3241b1bd20 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:02.134558 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:02.233466 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:02.233930 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:02.249510 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Calling delete_port for 744fb487-5ec9-46c5-aff9-8b3241b1bd20 owned by network:floatingip {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:02.392284 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:02.421871 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Pushing event deleted for resources: {'Port': ['ID=744fb487-5ec9-46c5-aff9-8b3241b1bd20,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:02.453629 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.454450 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.454802 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.455139 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.456092 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.456455 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.456910 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.457248 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.457753 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.458086 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.458984 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.459317 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:02.508311 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks [] for floatingip, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:02.510924 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:02.518570 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e167842c-5493-4225-9016-4a8216023034 tempest-AttachVolumeTestJSON-849734830 tempest-AttachVolumeTestJSON-849734830-project] 10.222.0.61 "DELETE /v2.0/floatingips/ba5a13eb-50e3-4e0f-8f17-d9a263efde9f HTTP/1.1" status: 204 len: 168 time: 0.5274253 Nov 12 15:02:02.778803 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5bc4f8d-aaf8-4f74-92bd-6254a20e7be8 req-c68b2f28-da3e-422e-9742-1af496e7afc3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:02.780574 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d5bc4f8d-aaf8-4f74-92bd-6254a20e7be8 req-c68b2f28-da3e-422e-9742-1af496e7afc3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0551682 Nov 12 15:02:02.838975 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device dd7d017f-a94d-4100-a980-fc29d066f333 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:02.864217 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d5bc4f8d-aaf8-4f74-92bd-6254a20e7be8 req-f3daa8ab-a3c8-4df0-9269-2e40ae084003 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0735774 Nov 12 15:02:02.864811 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: dd7d017f-a94d-4100-a980-fc29d066f333 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:02.864925 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device dd7d017f-a94d-4100-a980-fc29d066f333 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:03.995725 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3afac8-b6d6-40ea-a0bd-2152a22ded98 req-19e6d2e8-7768-4321-aa76-297165c4be4f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:03.997455 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6e3afac8-b6d6-40ea-a0bd-2152a22ded98 req-19e6d2e8-7768-4321-aa76-297165c4be4f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0546391 Nov 12 15:02:04.075802 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6e3afac8-b6d6-40ea-a0bd-2152a22ded98 req-9a5e80f6-7342-4cb3-8647-1d33670df5b5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0707526 Nov 12 15:02:04.991867 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:05.197604 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97710a6-2b67-4e3e-921f-aee06f9aa60e req-0947260f-689d-44eb-9f87-e3c52315ca81 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:05.205604 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f97710a6-2b67-4e3e-921f-aee06f9aa60e req-0947260f-689d-44eb-9f87-e3c52315ca81 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0577178 Nov 12 15:02:05.255999 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f97710a6-2b67-4e3e-921f-aee06f9aa60e req-4d4c72ad-534c-4901-9dbf-5565edbe386f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0487633 Nov 12 15:02:06.118916 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-d436fa02-6727-4311-b08e-47a92846a180 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:06.120469 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-d436fa02-6727-4311-b08e-47a92846a180 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 1099 time: 0.0461395 Nov 12 15:02:06.144217 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33134) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:06.213373 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-0f90cf35-27be-4b59-9a2e-8e4291a36adc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:06.214819 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-0f90cf35-27be-4b59-9a2e-8e4291a36adc service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.0858161 Nov 12 15:02:06.288132 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-d4bcda2f-2ea9-4e27-8b29-64b6a59703ea service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac HTTP/1.1" status: 200 len: 1001 time: 0.0647032 Nov 12 15:02:06.339040 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-29c23479-4bb9-4fa5-939c-cad200403a00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:06.340443 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-29c23479-4bb9-4fa5-939c-cad200403a00 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0449595 Nov 12 15:02:06.386461 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-e7c9aa05-aa5d-41f8-8068-7855fa32a47a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:06.387936 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-e7c9aa05-aa5d-41f8-8068-7855fa32a47a service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400441 Nov 12 15:02:06.426020 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992775e4-561a-4643-996c-41050ca2530a req-d8b03386-c1af-46f4-be9d-a74772bb264a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:06.427480 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-992775e4-561a-4643-996c-41050ca2530a req-d8b03386-c1af-46f4-be9d-a74772bb264a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0951908 Nov 12 15:02:06.480182 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-8a10570e-52b8-42f6-bf65-95199f1576b1 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852442 Nov 12 15:02:06.534881 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-992775e4-561a-4643-996c-41050ca2530a req-8e7f8f52-feaa-4f81-b586-5976014d8b63 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1013236 Nov 12 15:02:06.571600 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-452c3300-d496-4d04-a48a-33b95c9fb940 req-817d2499-5997-472e-b491-c73105a25ea7 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842054 Nov 12 15:02:06.657878 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1754847'] for router_interface, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:06.784578 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-e8bd4549-b174-42bd-a527-d4c0e84c56f6 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0437312 Nov 12 15:02:06.847689 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-30555ec1-8b23-42de-b627-fdff24793ae1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:06.849202 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-30555ec1-8b23-42de-b627-fdff24793ae1 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1137 time: 0.0406601 Nov 12 15:02:06.904704 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Deleting port ceb62b38-4fa2-461d-8699-99ddeedd36fb {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:06.905041 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:06.957223 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-cafd41d7-fdf6-4691-9e70-621882ca88c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:06.958677 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-cafd41d7-fdf6-4691-9e70-621882ca88c3 service neutron] 10.222.0.86 "GET /v2.0/networks?id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 200 len: 915 time: 0.0883880 Nov 12 15:02:06.991445 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] For port ceb62b38-4fa2-461d-8699-99ddeedd36fb, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=ceb62b38-4fa2-461d-8699-99ddeedd36fb,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:06.991829 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:07.004690 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Calling delete_port for ceb62b38-4fa2-461d-8699-99ddeedd36fb owned by network:router_interface {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:07.029384 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-9b4455c9-2dfa-4bf9-8c74-cbb416c32b10 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 1001 time: 0.0624075 Nov 12 15:02:07.080193 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-304ca640-dc0c-4ba9-9f8d-f5ebd1f651b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:07.081674 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-304ca640-dc0c-4ba9-9f8d-f5ebd1f651b2 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 HTTP/1.1" status: 200 len: 853 time: 0.0438075 Nov 12 15:02:07.130240 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-9af6b2b6-a7cd-4e9c-951f-3af35f0cd6bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:07.131761 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-9af6b2b6-a7cd-4e9c-951f-3af35f0cd6bc service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0412593 Nov 12 15:02:07.182244 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:07.207404 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Pushing event deleted for resources: {'Port': ['ID=ceb62b38-4fa2-461d-8699-99ddeedd36fb,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:07.231069 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-27640258-970b-4ada-8921-f81a3252971e service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0908287 Nov 12 15:02:07.334440 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-254a5080-b114-439c-8c34-4dbc31d8a4ac req-fff594ce-f7ea-41f9-8b7b-e8f50c2ee9a2 service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0946982 Nov 12 15:02:07.335099 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:02:07.374538 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611175', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1753199'] for router_interface, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:07.587016 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Router a08d9f45-c652-4276-867c-ab77c8f81aef has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:02:07.657706 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbab890-139e-414d-9472-65d99052848c req-cb54debc-c855-4286-ac22-5bfd2422747b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:07.659828 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ccbab890-139e-414d-9472-65d99052848c req-cb54debc-c855-4286-ac22-5bfd2422747b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.0519233 Nov 12 15:02:07.694318 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:02:07.699231 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-c9040d47-def6-4985-94f3-7c874189c163 admin admin] 10.222.0.61 "PUT /v2.0/routers/a08d9f45-c652-4276-867c-ab77c8f81aef/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5539908 Nov 12 15:02:07.701788 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33142) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:07.707731 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] Sync routers for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:02:07.708816 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ccbab890-139e-414d-9472-65d99052848c req-ac1a7438-891e-4d29-bc5e-e64c346d1586 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0429075 Nov 12 15:02:07.718196 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:07.719044 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:01:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:07.809065 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks [] for router, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:07.826394 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:07.911281 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:07.969402 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Deleting port 28e0c573-48d9-421d-be0b-6000eb77163c {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:07.969841 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.015787 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50'}], 'enable_snat': True}, 'gw_port_id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T15:02:07Z', 'revision_number': 5, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port': {'id': '28e0c573-48d9-421d-be0b-6000eb77163c', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:1e:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:54:58Z', 'updated_at': '2021-11-12T14:55:06Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:08.046804 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] Checking router: a08d9f45-c652-4276-867c-ab77c8f81aef for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:02:08.056300 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] Routers {'a08d9f45-c652-4276-867c-ab77c8f81aef'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:08.057002 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:01:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['a08d9f45-c652-4276-867c-ab77c8f81aef'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:08.061564 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] For port 28e0c573-48d9-421d-be0b-6000eb77163c, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=28e0c573-48d9-421d-be0b-6000eb77163c,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:08.061961 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.075980 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Calling delete_port for 28e0c573-48d9-421d-be0b-6000eb77163c owned by network:router_gateway {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:08.150096 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] Set router a08d9f45-c652-4276-867c-ab77c8f81aef gateway port host: None {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:08.201854 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T15:02:07Z', 'revision_number': 6, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port_host': None}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:08.231996 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2120459-26c3-467d-af05-5848b04d9333 None None] The sync data for ids ['a08d9f45-c652-4276-867c-ab77c8f81aef'] in dv-cinder-776422-5-iscsi is: [{'id': 'a08d9f45-c652-4276-867c-ab77c8f81aef', 'name': 'tempest-AttachVolumeTestJSON-1416349936-router', 'tenant_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:54:56Z', 'updated_at': '2021-11-12T15:02:07Z', 'revision_number': 6, 'project_id': 'e9ecca05e4af49c9b46cc186e0517c9c', 'gw_port_host': None}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:02:08.247494 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.275098 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Pushing event deleted for resources: {'Port': ['ID=28e0c573-48d9-421d-be0b-6000eb77163c,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:08.336978 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1760149'] for router_gateway, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.426771 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1755136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-43439'] for router, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.428996 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.477880 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1755257'] for router, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.478418 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Fanout notify agent at l3_agent the message router_deleted on router a08d9f45-c652-4276-867c-ab77c8f81aef {{(pid=101617) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 12 15:02:08.484270 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] Publish callbacks [] for router, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.485412 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-1d5418f4-5923-4924-876f-28d1098fb9bf admin admin] 10.222.0.61 "DELETE /v2.0/routers/a08d9f45-c652-4276-867c-ab77c8f81aef HTTP/1.1" status: 204 len: 168 time: 0.7827110 Nov 12 15:02:08.488517 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33144) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:08.535796 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-9af06ee2-2892-4b03-92e5-349fa829bf18 admin admin] Deleting subnet f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:02:08.538861 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9af06ee2-2892-4b03-92e5-349fa829bf18 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.573346 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9af06ee2-2892-4b03-92e5-349fa829bf18 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.686039 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9af06ee2-2892-4b03-92e5-349fa829bf18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.739971 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9af06ee2-2892-4b03-92e5-349fa829bf18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.766081 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af06ee2-2892-4b03-92e5-349fa829bf18 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:08.769705 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9af06ee2-2892-4b03-92e5-349fa829bf18 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.773085 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-9af06ee2-2892-4b03-92e5-349fa829bf18 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/f23f15e5-e9c9-4308-8b0c-c4b3f41f50e2 HTTP/1.1" status: 204 len: 168 time: 0.2833579 Nov 12 15:02:08.778330 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33148) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:08.785339 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0eba253-2114-4b12-aafa-45962e22e351 None None] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:02:08.854202 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:08.891957 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:08.908098 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dafd06c-98c2-4a42-9e89-58948437a345 req-a250e3ee-699e-4009-97f2-f6415b11e26d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:08.910145 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6dafd06c-98c2-4a42-9e89-58948437a345 req-a250e3ee-699e-4009-97f2-f6415b11e26d tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 946 time: 0.1191609 Nov 12 15:02:08.989265 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.010305 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6dafd06c-98c2-4a42-9e89-58948437a345 req-de5c8a08-3342-45dd-9e24-4dad7ca4def4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0934594 Nov 12 15:02:09.023419 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:02:09.029362 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Deleting port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:09.030035 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.036383 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a3c67888-525d-4e88-9e09-e09725bcb852" -d '{"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-unplugged", "status": "completed", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:09.065683 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:09.071480 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] DHCP port deletion for cf063ae4-6fb7-44b8-9c9f-984a39a87f66 request from dv-cinder-776422-5-iscsi {{(pid=101619) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 12 15:02:09.080886 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.151972 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Fri, 12 Nov 2021 15:02:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27600121-8628-4a54-8cad-8879c811a7a0 x-openstack-request-id: req-27600121-8628-4a54-8cad-8879c811a7a0 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:09.152408 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-unplugged", "status": "failed", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac", "code": 422}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:09.152667 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-27600121-8628-4a54-8cad-8879c811a7a0 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:09.153070 dv-cinder-776422-5-iscsi neutron-server[101619]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'code': 422} returned with failed status Nov 12 15:02:09.167238 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] For port 6ee7533c-cce1-4c6b-a77b-020ee68933f1, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=6ee7533c-cce1-4c6b-a77b-020ee68933f1,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:09.167744 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.173507 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device ceb62b38-4fa2-461d-8699-99ddeedd36fb no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:09.184905 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Calling delete_port for 6ee7533c-cce1-4c6b-a77b-020ee68933f1 owned by network:dhcp {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:09.209386 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: ceb62b38-4fa2-461d-8699-99ddeedd36fb {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:09.209731 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device ceb62b38-4fa2-461d-8699-99ddeedd36fb not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:09.210157 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 28e0c573-48d9-421d-be0b-6000eb77163c no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:09.211873 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=8']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:09.247781 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 28e0c573-48d9-421d-be0b-6000eb77163c {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:09.247781 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 28e0c573-48d9-421d-be0b-6000eb77163c not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:09.257298 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] Deleting port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 {{(pid=101619) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:09.257623 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.285282 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.322869 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Pushing event deleted for resources: {'Port': ['ID=6ee7533c-cce1-4c6b-a77b-020ee68933f1,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:09.333020 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] No DVR routers for this DVR port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 on host dv-cinder-776422-5-iscsi {{(pid=101617) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:02:09.347615 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] For port 6ee7533c-cce1-4c6b-a77b-020ee68933f1, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=6ee7533c-cce1-4c6b-a77b-020ee68933f1,segment=NetworkSegment(5f55f816-14d6-46e6-8ced-6c264b88865e),segment_id=5f55f816-14d6-46e6-8ced-6c264b88865e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:09.348266 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.364313 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] Calling delete_port for 6ee7533c-cce1-4c6b-a77b-020ee68933f1 owned by network:dhcp {{(pid=101619) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:09.409593 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.433288 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cf063ae4-6fb7-44b8-9c9f-984a39a87f66']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:09.443716 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5f55f816-14d6-46e6-8ced-6c264b88865e') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:09.444035 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5f55f816-14d6-46e6-8ced-6c264b88865e') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:09.459465 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.477495 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.491070 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Releasing vlan 642 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:02:09.491594 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:02:09.493907 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:02:09.561629 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.568273 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.574124 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] 10.222.0.61 "DELETE /v2.0/networks/cf063ae4-6fb7-44b8-9c9f-984a39a87f66 HTTP/1.1" status: 204 len: 168 time: 0.7953389 Nov 12 15:02:09.585484 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3416711e-3a30-4d2d-bb99-05d8855a477d admin admin] Pushing event deleted for resources: {'Network': ['ID=cf063ae4-6fb7-44b8-9c9f-984a39a87f66,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:09.684388 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.721861 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33174) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:09.730351 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] Network cf063ae4-6fb7-44b8-9c9f-984a39a87f66 is not hosted by any dhcp agent {{(pid=101619) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 12 15:02:09.731488 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] No DVR routers for this DVR port 6ee7533c-cce1-4c6b-a77b-020ee68933f1 on host dv-cinder-776422-5-iscsi {{(pid=101619) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:02:09.733643 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c827a418-ce12-4f7e-b2f2-95be5bf710de None None] Pushing event deleted for resources: {'Port': ['ID=6ee7533c-cce1-4c6b-a77b-020ee68933f1,revision_number=None']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:09.786214 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-fc1956ed-83f7-4089-a7f5-2e0352cf0cfe admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e9ecca05e4af49c9b46cc186e0517c9c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0630221 Nov 12 15:02:09.789295 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33178) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:09.842180 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b38404f5-5e2b-4e0e-b770-e318fdb7959e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.864530 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b38404f5-5e2b-4e0e-b770-e318fdb7959e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.912561 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b38404f5-5e2b-4e0e-b770-e318fdb7959e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.915169 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b38404f5-5e2b-4e0e-b770-e318fdb7959e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:09.916352 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b38404f5-5e2b-4e0e-b770-e318fdb7959e admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/c43c8cee-a574-46dd-a048-f6b09bf7f409 HTTP/1.1" status: 204 len: 168 time: 0.1260421 Nov 12 15:02:09.924671 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b38404f5-5e2b-4e0e-b770-e318fdb7959e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c43c8cee-a574-46dd-a048-f6b09bf7f409,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:10.025022 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [req-5f7aed53-283f-4955-ac43-9a5675fe95e6 req-0a325a63-813b-4052-b56c-d1ce875f59bb service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101617) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 15:02:10.026033 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5f7aed53-283f-4955-ac43-9a5675fe95e6 req-0a325a63-813b-4052-b56c-d1ce875f59bb service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0055277 Nov 12 15:02:10.217562 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c3008f3-2df3-47bc-8a2c-df09b936953d req-e7cba6aa-edf3-42a9-b128-8d9e2a817947 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:10.219376 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9c3008f3-2df3-47bc-8a2c-df09b936953d req-e7cba6aa-edf3-42a9-b128-8d9e2a817947 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0708134 Nov 12 15:02:10.245307 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-d7876c37-4bbb-48fd-80f1-9b2b138600e0 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0410202 Nov 12 15:02:10.281694 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9c3008f3-2df3-47bc-8a2c-df09b936953d req-fd0ada31-964b-4a3d-81ed-ffb388c20fb4 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0551639 Nov 12 15:02:10.655318 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33220) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:10.759517 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1155495571-network', 'tenant_id': '4a3b37db0a5944228023e883b9a67692'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:10.780540 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Made reservation on behalf of 4a3b37db0a5944228023e883b9a67692 for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:02:10.782909 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:10.792208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:10.869237 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 6ee7533c-cce1-4c6b-a77b-020ee68933f1 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:10.872575 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:10.877719 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:10.889538 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 6ee7533c-cce1-4c6b-a77b-020ee68933f1 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:10.889884 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 6ee7533c-cce1-4c6b-a77b-020ee68933f1 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:10.899023 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 625} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 15:02:10.915398 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=539cc6ba-204a-40d6-ad9e-2c68855faf0e,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:10.918385 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:10.918780 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Added segment 8468f3e5-d352-48c2-8969-f6c1eb1e52f6 of type vlan for network b3def5d6-542f-430c-929b-c115bf33a381 Nov 12 15:02:10.958608 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:10.983086 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:10.984067 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:10.984718 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:11.019689 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3631983 Nov 12 15:02:11.022795 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33224) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:11.027683 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Request body: {'subnet': {'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1155495571-subnet', 'tenant_id': '4a3b37db0a5944228023e883b9a67692', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:11.057395 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Made reservation on behalf of 4a3b37db0a5944228023e883b9a67692 for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:02:11.059807 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5175757'] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:11.076541 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42fca20-dfb7-4090-a6c0-97b3a7e8edc1 admin admin] Pushing event updated for resources: {'Network': ['ID=b3def5d6-542f-430c-929b-c115bf33a381,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:11.087898 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network b3def5d6-542f-430c-929b-c115bf33a381 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 15:02:11.093626 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-f988be95-9157-4666-8b0d-1f4a24413e58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:11.095420 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-f988be95-9157-4666-8b0d-1f4a24413e58 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642&tenant_id=296b2e6385f04550a366eb21cf48ea40 HTTP/1.1" status: 200 len: 1097 time: 0.0745692 Nov 12 15:02:11.171194 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-b35f6ebb-4766-4bd5-8214-6513d06fe3c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:11.172768 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-b35f6ebb-4766-4bd5-8214-6513d06fe3c0 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 1097 time: 0.0508800 Nov 12 15:02:11.234198 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7428832', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5175775'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:11.270521 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-4395c988-469b-444e-a2dd-159b7ba45829 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:11.272071 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-4395c988-469b-444e-a2dd-159b7ba45829 service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.0911322 Nov 12 15:02:11.351768 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-58bead2c-5001-4613-a7b2-0e37f94b4229 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac HTTP/1.1" status: 200 len: 999 time: 0.0664423 Nov 12 15:02:11.409965 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-90c9e6b2-fcbb-40b6-aa5c-eb59ee7dc11b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:11.411453 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-90c9e6b2-fcbb-40b6-aa5c-eb59ee7dc11b service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0531125 Nov 12 15:02:11.459726 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-6cf39608-a8b6-41d4-bc74-7b5f3ba2e30b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:11.461257 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-6cf39608-a8b6-41d4-bc74-7b5f3ba2e30b service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0421066 Nov 12 15:02:11.536488 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Pushing event updated for resources: {'Subnet': ['ID=6c234914-5201-4acb-90e6-43368a9bb837,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:11.559677 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Checking segment: {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:11.560030 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Network hostable DHCP agents. Network: b3def5d6-542f-430c-929b-c115bf33a381, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 15:02:11.561502 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-bd1be8e3-669f-4dea-98ff-afdbe9641f47 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877807 Nov 12 15:02:11.570695 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53c7a1de-78e0-4ee5-b9e2-a8a74dc34f55 req-3e269927-efa9-4105-aad0-3a6e9158e828 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:11.572169 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-53c7a1de-78e0-4ee5-b9e2-a8a74dc34f55 req-3e269927-efa9-4105-aad0-3a6e9158e828 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0868673 Nov 12 15:02:11.604232 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Network b3def5d6-542f-430c-929b-c115bf33a381 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 15:02:11.623947 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, b3def5d6-542f-430c-929b-c115bf33a381) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:11.631826 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:11.632430 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:11.639036 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-53c7a1de-78e0-4ee5-b9e2-a8a74dc34f55 req-d639250e-06f8-4d67-a55e-34db103c589c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0600283 Nov 12 15:02:11.639497 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7e1cce5-30ce-4886-8cfb-eae796a1bce3 None None] Network b3def5d6-542f-430c-929b-c115bf33a381 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:02:11.654669 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-82b23287-759d-42e7-92c7-2abf69a2e94e admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.6306932 Nov 12 15:02:11.673365 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1453c1a7-2d83-46e0-b017-d4943b6f55ba req-586553c7-b5c4-4dd7-b958-b5af54fe52b0 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1038799 Nov 12 15:02:11.785306 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e0ed664-276e-4303-81e8-f8930edcb063 None None] Network b3def5d6-542f-430c-929b-c115bf33a381 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:02:12.113377 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c36db059-c012-4a00-afe2-3c75ca6ec8dc tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:12.114755 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c36db059-c012-4a00-afe2-3c75ca6ec8dc tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 815 time: 0.1062574 Nov 12 15:02:12.132590 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-b75ae1d5-4a4d-48e9-9c9a-6e6eac133859 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/quotas/4a3b37db0a5944228023e883b9a67692 HTTP/1.1" status: 200 len: 375 time: 0.0113294 Nov 12 15:02:12.167837 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c79d74f0-b53d-4742-988e-b864f6125fab tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0292265 Nov 12 15:02:12.300429 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-52f3aa3c-fa31-4703-ba7b-7535da1d311e service neutron] 10.222.0.61 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272030 Nov 12 15:02:12.401048 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-4c19469c-6430-41ce-814e-cd79115edfae service neutron] 10.222.0.61 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0995755 Nov 12 15:02:12.588768 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-82151815-5d0b-4526-b7d1-223192335b59 req-11c02b15-5448-4f4f-b8cb-5cde11d56621 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0383201 Nov 12 15:02:12.780378 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a811b99c-c7a7-40ef-bbfc-f2745b9591cd req-23267aee-3908-48f4-b88c-d2e97203a6d6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:12.782036 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a811b99c-c7a7-40ef-bbfc-f2745b9591cd req-23267aee-3908-48f4-b88c-d2e97203a6d6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0668585 Nov 12 15:02:12.839928 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a811b99c-c7a7-40ef-bbfc-f2745b9591cd req-44240f53-f342-479a-8ff1-69f47a1efad1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0504899 Nov 12 15:02:12.865021 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:13.688094 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-87423193-3c50-441b-b820-97d9a38a84ad req-1a260f37-232f-440c-9480-038aeef53951 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0292194 Nov 12 15:02:13.965076 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb380ce5-ffa2-40ba-843d-24590ec0269c req-77b5d729-8fb9-4db9-b3af-b2b6fb56b31e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:13.966697 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cb380ce5-ffa2-40ba-843d-24590ec0269c req-77b5d729-8fb9-4db9-b3af-b2b6fb56b31e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0554028 Nov 12 15:02:14.021449 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cb380ce5-ffa2-40ba-843d-24590ec0269c req-1c4da7d9-1766-41cc-8bee-eb2627732870 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0480812 Nov 12 15:02:14.787224 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-54c5f124-c618-410a-b8f9-58119a34be1d req-8d9da5fa-f8fb-4551-a463-4ddea9a269bd tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0286610 Nov 12 15:02:15.146896 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5339052-9abe-4858-854f-75e6fd8683b2 req-48db74b9-8864-4a00-ac63-49fefc50e4c3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:15.149464 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5339052-9abe-4858-854f-75e6fd8683b2 req-48db74b9-8864-4a00-ac63-49fefc50e4c3 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0512216 Nov 12 15:02:15.205121 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f5339052-9abe-4858-854f-75e6fd8683b2 req-d8a8a988-3e89-40fe-85da-085c82229382 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0476532 Nov 12 15:02:15.887778 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b428fcf7-dffe-46d3-809e-b42c485a3cf0 req-d443ac1a-9a80-411b-b425-7661d344a1bd tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0285029 Nov 12 15:02:16.330889 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605cb6d1-ee8f-4dab-b0dc-819a6c43510d req-fc058984-c9c1-41ac-bfad-c3651c1cd992 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:16.332955 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-605cb6d1-ee8f-4dab-b0dc-819a6c43510d req-fc058984-c9c1-41ac-bfad-c3651c1cd992 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0541897 Nov 12 15:02:16.399939 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-605cb6d1-ee8f-4dab-b0dc-819a6c43510d req-ec507c03-ee25-47cc-a43a-445dc09742b5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0608115 Nov 12 15:02:16.985167 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f36a1da8-7930-4476-a79b-e03a47a46610 req-20d89a4b-f372-4b0c-be98-069d69c81d33 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0267007 Nov 12 15:02:17.532442 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68713a10-88f6-42a7-8769-98dcc101a7de req-b8b07b15-1078-47d6-964a-81da0a38efd6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:17.534672 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-68713a10-88f6-42a7-8769-98dcc101a7de req-b8b07b15-1078-47d6-964a-81da0a38efd6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0581605 Nov 12 15:02:17.583715 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-68713a10-88f6-42a7-8769-98dcc101a7de req-45c29aa8-a166-41be-8bae-7be674994e93 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0427647 Nov 12 15:02:18.094731 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-167ed777-9f8d-4b4c-9176-bda57039a845 req-96eb7bc4-fca2-4a27-b5cb-2251f1e47fc1 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0350094 Nov 12 15:02:18.711451 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3c9747-6e50-41c3-a341-bf65dbf7ce54 req-3ec031f3-b92e-4a2d-bb3c-4ba47034d80f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:18.713128 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3c9747-6e50-41c3-a341-bf65dbf7ce54 req-3ec031f3-b92e-4a2d-bb3c-4ba47034d80f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0513749 Nov 12 15:02:18.767883 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-de3c9747-6e50-41c3-a341-bf65dbf7ce54 req-eba4ca75-cda0-4f12-936d-95aa6083d1e1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0481455 Nov 12 15:02:19.194194 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7218e2d7-e26e-4fb7-ad93-c5460fdd4372 req-42db71c1-16ce-4461-8d5d-b1a17a3fd2a3 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0265079 Nov 12 15:02:19.889887 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8771148-a59e-4524-aa51-05eefc340cba req-08546ae5-d47d-42fb-8dee-d8fe1e4b4bc1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:19.891353 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d8771148-a59e-4524-aa51-05eefc340cba req-08546ae5-d47d-42fb-8dee-d8fe1e4b4bc1 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0501907 Nov 12 15:02:19.946612 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d8771148-a59e-4524-aa51-05eefc340cba req-82e0d205-75a7-4415-8daf-17f9c86561c6 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0485456 Nov 12 15:02:20.293126 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-79881f4e-117c-497f-96e2-7b28c1e28f5f req-a7159b99-7ab3-46ae-8ad1-c322ff5a2d0b tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0286503 Nov 12 15:02:21.073532 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b26a140a-cb38-44c5-8a67-c51d1ae7e126 req-9b1ee253-b4cc-437a-a5a6-616519d0ffcf tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:21.075103 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b26a140a-cb38-44c5-8a67-c51d1ae7e126 req-9b1ee253-b4cc-437a-a5a6-616519d0ffcf tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0511858 Nov 12 15:02:21.125148 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-b26a140a-cb38-44c5-8a67-c51d1ae7e126 req-b1a92743-1563-4d37-a566-e68e0491ba20 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0431619 Nov 12 15:02:21.389328 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6b266704-72b8-40d5-8896-86311c9d2192 req-3632e709-5469-4500-8d50-fba9351c91c0 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0274951 Nov 12 15:02:22.106026 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-73677787-ecd4-42e5-8950-712d5062f2be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:22.264566 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc8de95-77aa-400b-b77c-043a3a4dec81 req-de47462f-8189-4677-892d-3ab1654d8b9f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:22.266040 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2fc8de95-77aa-400b-b77c-043a3a4dec81 req-de47462f-8189-4677-892d-3ab1654d8b9f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0582950 Nov 12 15:02:22.327893 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2fc8de95-77aa-400b-b77c-043a3a4dec81 req-012ff4dc-ca21-4810-9b94-3e164bb0081f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0552909 Nov 12 15:02:22.492470 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-31a5c5c4-4df2-4beb-9597-76af9812bcde req-1fa17052-86e3-40f2-b296-6b4673a67f72 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0282419 Nov 12 15:02:23.462500 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adc3e12a-d087-42d1-8af5-cef417aabeee req-88c2f7ec-cbb1-41c3-93d7-b6cd6c76700b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:23.464010 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-adc3e12a-d087-42d1-8af5-cef417aabeee req-88c2f7ec-cbb1-41c3-93d7-b6cd6c76700b tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.0601842 Nov 12 15:02:23.510226 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-adc3e12a-d087-42d1-8af5-cef417aabeee req-9b5c1ec1-b46e-4027-9a5d-c77cb869e211 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0402987 Nov 12 15:02:23.585955 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0af367ad-c96b-4627-900c-ce694886f438 req-0af4fc06-ee4b-428a-8d6a-5d94768b8965 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0256209 Nov 12 15:02:23.900392 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-53f149c0-59a9-4abd-9643-9a45f8b8e66c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:23.901775 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-53f149c0-59a9-4abd-9643-9a45f8b8e66c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 815 time: 0.1081901 Nov 12 15:02:23.917764 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Request body: {'port': {'device_id': '55ae80dd-c881-495d-b393-37f714977cb2', 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381', 'admin_state_up': True, 'tenant_id': '4a3b37db0a5944228023e883b9a67692'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:24.029354 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Made reservation on behalf of 4a3b37db0a5944228023e883b9a67692 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:02:24.033538 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:24.159110 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Allocated IP 172.20.0.5 (b3def5d6-542f-430c-929b-c115bf33a381/6c234914-5201-4acb-90e6-43368a9bb837/80209aed-5240-4dda-915c-40b00a2280c7) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:02:24.304384 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:24.340570 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:24.384360 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Network b3def5d6-542f-430c-929b-c115bf33a381 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:24.389954 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:24.394318 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:02:24.400868 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Pushing event updated for resources: {'Port': ['ID=80209aed-5240-4dda-915c-40b00a2280c7,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:24.446185 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:24.446787 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:24.462863 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-c26e508c-f63d-415d-9cff-a93a2de7f7fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5488882 Nov 12 15:02:24.476409 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Request body: {'port': {'device_id': '55ae80dd-c881-495d-b393-37f714977cb2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:24.534241 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:24.545807 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8d277100-91ee-4ddd-bd27-95379a68887d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:24.701213 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2d25ad-6e12-47b6-8386-c80de1390040 req-7d2ca8c0-aae6-4b5e-8671-908f4473a11c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:24.702636 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6a2d25ad-6e12-47b6-8386-c80de1390040 req-7d2ca8c0-aae6-4b5e-8671-908f4473a11c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 931 time: 0.0490544 Nov 12 15:02:24.712832 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e709bd2a-423f-42db-9412-a99c428e6b7c req-209ec59f-4b69-4d3c-a971-0763a7d66c06 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:24.714417 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e709bd2a-423f-42db-9412-a99c428e6b7c req-209ec59f-4b69-4d3c-a971-0763a7d66c06 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 944 time: 0.1307967 Nov 12 15:02:24.754326 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6a2d25ad-6e12-47b6-8386-c80de1390040 req-2cf3381b-6cbf-4bbc-9597-e398d9d4d19a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445800 Nov 12 15:02:24.803701 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e709bd2a-423f-42db-9412-a99c428e6b7c req-cca5c606-bb32-4a8f-bb3d-a0385f72a4b5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0828092 Nov 12 15:02:24.876874 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 80209aed-5240-4dda-915c-40b00a2280c7 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:02:24.884191 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:24.896424 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Transition to ACTIVE for port object 80209aed-5240-4dda-915c-40b00a2280c7 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:02:24.900558 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:24.946289 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:02:24.948492 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Pushing event updated for resources: {'Port': ['ID=80209aed-5240-4dda-915c-40b00a2280c7,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:25.016517 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Attempting to bind port 80209aed-5240-4dda-915c-40b00a2280c7 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:02:25.016883 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Attempting to bind port 80209aed-5240-4dda-915c-40b00a2280c7 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:02:25.017212 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Attempting to bind port 80209aed-5240-4dda-915c-40b00a2280c7 on network b3def5d6-542f-430c-929b-c115bf33a381 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:25.021465 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Port 80209aed-5240-4dda-915c-40b00a2280c7 on network b3def5d6-542f-430c-929b-c115bf33a381 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:02:25.021772 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Attempting to bind port 80209aed-5240-4dda-915c-40b00a2280c7 on network b3def5d6-542f-430c-929b-c115bf33a381 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:25.026543 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 2, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:02:25.026873 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Checking segment: {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:25.027248 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Bound using segment: {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:02:25.027666 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Bound port: 80209aed-5240-4dda-915c-40b00a2280c7, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:02:25.028016 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:25.042910 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:25.054763 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'port_id': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'mac_address': 'fa:16:3e:50:13:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 638, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:02:25.091036 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:25.093011 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] For port 80209aed-5240-4dda-915c-40b00a2280c7, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:02:25.096721 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] For port 80209aed-5240-4dda-915c-40b00a2280c7, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=80209aed-5240-4dda-915c-40b00a2280c7,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:02:25.101341 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:25.104428 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b0bd777f-598e-4de7-ab20-79ef7b06cdac {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:02:25.124353 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:25.128164 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:25.136599 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:25.137221 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:25.138926 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] 10.222.0.86 "PUT /v2.0/ports/80209aed-5240-4dda-915c-40b00a2280c7 HTTP/1.1" status: 200 len: 1093 time: 0.6664979 Nov 12 15:02:25.139352 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '55ae80dd-c881-495d-b393-37f714977cb2', 'tag': '80209aed-5240-4dda-915c-40b00a2280c7'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:02:25.141619 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e089f966-b332-46e7-8520-e6bd89118105" -d '{"events": [{"name": "network-changed", "server_uuid": "55ae80dd-c881-495d-b393-37f714977cb2", "tag": "80209aed-5240-4dda-915c-40b00a2280c7"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:25.177534 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ebd998b-be45-4d3b-ba5a-3d11984e829a service neutron] Pushing event updated for resources: {'Port': ['ID=80209aed-5240-4dda-915c-40b00a2280c7,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:25.179266 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=9']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:25.183396 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:02:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0d6ea5d-4b3e-4729-b833-910aade82e18 x-openstack-request-id: req-a0d6ea5d-4b3e-4729-b833-910aade82e18 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:25.184311 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "55ae80dd-c881-495d-b393-37f714977cb2", "tag": "80209aed-5240-4dda-915c-40b00a2280c7", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:25.184564 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-a0d6ea5d-4b3e-4729-b833-910aade82e18 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:25.184959 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '55ae80dd-c881-495d-b393-37f714977cb2', 'tag': '80209aed-5240-4dda-915c-40b00a2280c7', 'status': 'completed', 'code': 200} Nov 12 15:02:25.231225 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5adf24a3-f2e5-44fb-8ddb-41b827b736e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:25.232712 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-5adf24a3-f2e5-44fb-8ddb-41b827b736e0 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 1096 time: 0.0412002 Nov 12 15:02:25.391762 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['b0bd777f-598e-4de7-ab20-79ef7b06cdac'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:02:25.515551 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-96cb0e2c-5f35-413c-8811-1a9dc8de0eea service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=80209aed-5240-4dda-915c-40b00a2280c7 HTTP/1.1" status: 200 len: 217 time: 0.2731495 Nov 12 15:02:25.543598 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:25.567646 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-4bce79f1-c0c6-4bea-8b41-384ec816641c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:25.569118 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-4bce79f1-c0c6-4bea-8b41-384ec816641c service neutron] 10.222.0.86 "GET /v2.0/subnets?id=6c234914-5201-4acb-90e6-43368a9bb837 HTTP/1.1" status: 200 len: 855 time: 0.0452561 Nov 12 15:02:25.601996 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-fc983d4a-22e0-4747-b570-2ff10a0434c5 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b3def5d6-542f-430c-929b-c115bf33a381&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249310 Nov 12 15:02:25.695941 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-dcb5e2cf-f795-4137-95b7-3ed7071592e6 service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863395 Nov 12 15:02:25.789253 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8c522bc1-3c28-4bd9-81d1-2804efcf44b6 req-a067af1f-098c-40d7-8708-0623fbee80ce service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847924 Nov 12 15:02:25.903524 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc84bd71-3524-4e5e-b00d-4463103b0d5c req-14471652-9d0d-4ad1-8b66-37b31648e19c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:25.905058 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dc84bd71-3524-4e5e-b00d-4463103b0d5c req-14471652-9d0d-4ad1-8b66-37b31648e19c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 943 time: 0.0816567 Nov 12 15:02:25.911844 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e089f966-b332-46e7-8520-e6bd89118105 req-bf02ffa1-6e9b-49de-a590-c5da16b7db0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:25.913313 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e089f966-b332-46e7-8520-e6bd89118105 req-bf02ffa1-6e9b-49de-a590-c5da16b7db0d service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 1096 time: 0.0633605 Nov 12 15:02:25.938122 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe28e206-d615-41fc-8eb0-4c076a22c144 req-00231512-9222-4e8a-a379-c0dbc676b0ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:25.940146 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fe28e206-d615-41fc-8eb0-4c076a22c144 req-00231512-9222-4e8a-a379-c0dbc676b0ca tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 945 time: 0.0493064 Nov 12 15:02:25.988048 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fe28e206-d615-41fc-8eb0-4c076a22c144 req-374aab5b-b641-4ef2-a2a6-baa7e5862822 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0417943 Nov 12 15:02:26.007433 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dc84bd71-3524-4e5e-b00d-4463103b0d5c req-750d54a8-569d-40fb-a486-4dd45a8267f7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931966 Nov 12 15:02:26.038724 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e089f966-b332-46e7-8520-e6bd89118105 req-8585b314-ef11-4746-9dc1-3639c3f6c1b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:26.040381 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e089f966-b332-46e7-8520-e6bd89118105 req-8585b314-ef11-4746-9dc1-3639c3f6c1b1 service neutron] 10.222.0.86 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 916 time: 0.1133935 Nov 12 15:02:26.082117 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e089f966-b332-46e7-8520-e6bd89118105 req-829acaa3-6e5d-4b78-ac67-046b16903bfb service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=80209aed-5240-4dda-915c-40b00a2280c7 HTTP/1.1" status: 200 len: 217 time: 0.0342977 Nov 12 15:02:26.130541 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e089f966-b332-46e7-8520-e6bd89118105 req-51e44828-22dd-459e-93e8-e4941c1ac1fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:26.131945 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e089f966-b332-46e7-8520-e6bd89118105 req-51e44828-22dd-459e-93e8-e4941c1ac1fb service neutron] 10.222.0.86 "GET /v2.0/subnets?id=6c234914-5201-4acb-90e6-43368a9bb837 HTTP/1.1" status: 200 len: 855 time: 0.0430758 Nov 12 15:02:26.167878 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e089f966-b332-46e7-8520-e6bd89118105 req-19de2670-e1b4-45fe-b9f6-9bc00f2a7767 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b3def5d6-542f-430c-929b-c115bf33a381&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0246630 Nov 12 15:02:26.262837 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e089f966-b332-46e7-8520-e6bd89118105 req-4a4edcec-8c9f-4387-a59e-2a8198ab63fa service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870001 Nov 12 15:02:26.350748 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e089f966-b332-46e7-8520-e6bd89118105 req-2db24c1d-ad02-4f13-a3cd-8843b3735323 service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796571 Nov 12 15:02:26.949235 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:26.955009 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:27.006668 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port b0bd777f-598e-4de7-ab20-79ef7b06cdac triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:27.007035 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:27.089078 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:27.114090 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:02:27.116391 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cda2ac6b-adae-4f09-b072-8787477c551f" -d '{"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-plugged", "status": "completed", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:27.121568 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30c18c63-acd8-4836-b795-7aa04aa1f6c6 req-e9d7673c-2f3d-4acd-adee-3ef1931faeed tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:27.123784 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-30c18c63-acd8-4836-b795-7aa04aa1f6c6 req-e9d7673c-2f3d-4acd-adee-3ef1931faeed tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 945 time: 0.0535524 Nov 12 15:02:27.130480 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:27.135847 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:27.136039 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58309d34-571b-40b7-9a43-d39fcc072ee5 req-c084cb1a-25dd-4a84-8694-1d9f7d9aeae2 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:27.137421 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-58309d34-571b-40b7-9a43-d39fcc072ee5 req-c084cb1a-25dd-4a84-8694-1d9f7d9aeae2 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 943 time: 0.0571725 Nov 12 15:02:27.181511 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-30c18c63-acd8-4836-b795-7aa04aa1f6c6 req-266bd55e-6035-4a59-b884-5efb2953588c tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0506852 Nov 12 15:02:27.187058 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=10']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:27.192944 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-58309d34-571b-40b7-9a43-d39fcc072ee5 req-f79a2c82-4ac8-4649-9815-293c795cdeb6 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473738 Nov 12 15:02:27.236326 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:02:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b811f2a0-e483-4602-9596-f49680085650 x-openstack-request-id: req-b811f2a0-e483-4602-9596-f49680085650 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:27.236612 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-plugged", "status": "completed", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:27.236857 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b811f2a0-e483-4602-9596-f49680085650 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:27.237242 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'code': 200} Nov 12 15:02:27.414990 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a5b2669-b87e-4015-9f0e-2cdf43a28123 req-0c7cd6ca-f8cb-4739-9827-5fee8f030848 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:27.416476 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5a5b2669-b87e-4015-9f0e-2cdf43a28123 req-0c7cd6ca-f8cb-4739-9827-5fee8f030848 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 1100 time: 0.0392315 Nov 12 15:02:27.460545 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5a5b2669-b87e-4015-9f0e-2cdf43a28123 req-5691fa4f-de1d-4691-85e1-6e2b50b6f3ce service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0361025 Nov 12 15:02:27.927448 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:28.311567 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b80dac1c-33d0-44a2-bad5-af75e820cc07 req-199b4e61-eea2-4e84-b58e-115b4921cbca tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:28.313062 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b80dac1c-33d0-44a2-bad5-af75e820cc07 req-199b4e61-eea2-4e84-b58e-115b4921cbca tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 943 time: 0.0530286 Nov 12 15:02:28.316337 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8878cb7f-5d0b-453e-bb7e-9d09913a3f92 req-ee5fd283-f5a1-491f-b7a3-1ee7c1bc2025 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:28.317803 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8878cb7f-5d0b-453e-bb7e-9d09913a3f92 req-ee5fd283-f5a1-491f-b7a3-1ee7c1bc2025 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 947 time: 0.0526876 Nov 12 15:02:28.359873 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b80dac1c-33d0-44a2-bad5-af75e820cc07 req-16048b68-9e50-4503-86be-9d2c7c66eaa0 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406241 Nov 12 15:02:28.364870 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8878cb7f-5d0b-453e-bb7e-9d09913a3f92 req-b83f5c62-1cac-4d8f-8a65-044280a7643a tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0412478 Nov 12 15:02:28.741261 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-b00b401c-751e-4ca1-9ee8-02152d2b3d77 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1360662033&fields=id&tenant_id=081b60b81cf04cd28b26a5b5cf5d5888 HTTP/1.1" status: 200 len: 267 time: 0.0481012 Nov 12 15:02:28.799787 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-e9d5ddb2-4ffb-43c4-8048-fcdd362a7798 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:28.801305 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-e9d5ddb2-4ffb-43c4-8048-fcdd362a7798 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 984 time: 0.0537076 Nov 12 15:02:28.812698 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-97ca78bb-ce0b-4934-bc5d-16426d03d1b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Request body: {'port': {'security_groups': ['407a8ee7-48fd-4e47-a4e0-23203c0a793d']}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:28.887609 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-97ca78bb-ce0b-4934-bc5d-16426d03d1b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:28.971890 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 80209aed-5240-4dda-915c-40b00a2280c7 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:02:29.068634 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 80209aed-5240-4dda-915c-40b00a2280c7, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=80209aed-5240-4dda-915c-40b00a2280c7,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:29.080823 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '80209aed-5240-4dda-915c-40b00a2280c7', 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381', 'port_id': '80209aed-5240-4dda-915c-40b00a2280c7', 'mac_address': 'fa:16:3e:11:4f:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 625, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6c234914-5201-4acb-90e6-43368a9bb837', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:02:29.112452 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-97ca78bb-ce0b-4934-bc5d-16426d03d1b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] For port 37ce8a4b-01d0-4c8c-8665-8f6627848b39, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:29.126773 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.141036 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 80209aed-5240-4dda-915c-40b00a2280c7 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:02:29.156917 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-97ca78bb-ce0b-4934-bc5d-16426d03d1b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for port, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.162281 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-97ca78bb-ce0b-4934-bc5d-16426d03d1b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7428717'] for port, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.169154 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 80209aed-5240-4dda-915c-40b00a2280c7, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=80209aed-5240-4dda-915c-40b00a2280c7,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:29.173323 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.208558 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-97ca78bb-ce0b-4934-bc5d-16426d03d1b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:29.209061 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['37ce8a4b-01d0-4c8c-8665-8f6627848b39'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:02:29.209241 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-97ca78bb-ce0b-4934-bc5d-16426d03d1b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.210779 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c6d78bae-0589-481a-9ed9-e4553c65a519 req-97ca78bb-ce0b-4934-bc5d-16426d03d1b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "PUT /v2.0/ports/37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 942 time: 0.4030051 Nov 12 15:02:29.211244 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39'}] {{(pid=101617) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:02:29.216698 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a89741189a1474522a3f12d6512a4dfa907db76ed85a3c525a03538a87d7317" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd9332b0-071d-474b-8727-1bb409886875" -d '{"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39"}]}' {{(pid=101617) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:29.216917 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33388) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:29.231792 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=80209aed-5240-4dda-915c-40b00a2280c7,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:29.252979 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97ca78bb-ce0b-4934-bc5d-16426d03d1b3 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event updated for resources: {'Port': ['ID=37ce8a4b-01d0-4c8c-8665-8f6627848b39,revision_number=7']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:29.278499 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:02:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d76d8fe-d7c3-4882-ab16-497bf2b97958 x-openstack-request-id: req-9d76d8fe-d7c3-4882-ab16-497bf2b97958 {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:29.278793 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39", "status": "completed", "code": 200}]} {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:29.279046 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-9d76d8fe-d7c3-4882-ab16-497bf2b97958 {{(pid=101617) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:29.279523 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'status': 'completed', 'code': 200} Nov 12 15:02:29.324973 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['37ce8a4b-01d0-4c8c-8665-8f6627848b39'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:02:29.341330 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-30a04eb7-2a51-4aea-85ce-267a0a52bf45 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.376464 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-30a04eb7-2a51-4aea-85ce-267a0a52bf45 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.407208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd9332b0-071d-474b-8727-1bb409886875 req-76c35bb9-346a-4a0c-be8d-34a2066eca9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:29.408790 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dd9332b0-071d-474b-8727-1bb409886875 req-76c35bb9-346a-4a0c-be8d-34a2066eca9f service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1098 time: 0.1023331 Nov 12 15:02:29.473221 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['80209aed-5240-4dda-915c-40b00a2280c7'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:02:29.514152 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac16f794-5474-403c-b801-5d01901003d4 req-52a695d3-6eee-48d0-a0a7-a550ab4e248b tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:29.516088 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ac16f794-5474-403c-b801-5d01901003d4 req-52a695d3-6eee-48d0-a0a7-a550ab4e248b tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 944 time: 0.0669754 Nov 12 15:02:29.562208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd9332b0-071d-474b-8727-1bb409886875 req-c3673d36-9e4e-4eb8-b868-5bcce6e400c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:29.564459 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dd9332b0-071d-474b-8727-1bb409886875 req-c3673d36-9e4e-4eb8-b868-5bcce6e400c0 service neutron] 10.222.0.86 "GET /v2.0/networks?id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 200 len: 915 time: 0.1479456 Nov 12 15:02:29.580044 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-5d6ca812-54d8-4706-a12e-b27746bb675f None None] Provisioning complete for port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:29.580433 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5d6ca812-54d8-4706-a12e-b27746bb675f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.580737 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7efcc673-8220-4513-a63b-a8361780dc7e req-9bbbeaac-9904-47c4-af41-401f556057a5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:29.582236 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7efcc673-8220-4513-a63b-a8361780dc7e req-9bbbeaac-9904-47c4-af41-401f556057a5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 947 time: 0.0876923 Nov 12 15:02:29.585456 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ac16f794-5474-403c-b801-5d01901003d4 req-66c5cc08-2aee-4b8e-ac7d-c867418690f6 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597732 Nov 12 15:02:29.655377 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-30a04eb7-2a51-4aea-85ce-267a0a52bf45 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.659626 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-30a04eb7-2a51-4aea-85ce-267a0a52bf45 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.660868 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-30a04eb7-2a51-4aea-85ce-267a0a52bf45 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "DELETE /v2.0/security-groups/ffdab7b5-4d64-44ab-bdca-dfd461f30c9f HTTP/1.1" status: 204 len: 168 time: 0.4429979 Nov 12 15:02:29.663901 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33396) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:29.695165 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a04eb7-2a51-4aea-85ce-267a0a52bf45 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ffdab7b5-4d64-44ab-bdca-dfd461f30c9f,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:29.712872 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dd9332b0-071d-474b-8727-1bb409886875 req-a9af848c-4476-46d6-8e33-79f84209bc71 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 1001 time: 0.1296577 Nov 12 15:02:29.717569 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7efcc673-8220-4513-a63b-a8361780dc7e req-ee10434a-67fd-490f-87a9-8cf21dec5d4e tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0878613 Nov 12 15:02:29.770055 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd9332b0-071d-474b-8727-1bb409886875 req-1affb4f5-7b98-4353-b866-b81c0ae42ffa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:29.771492 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dd9332b0-071d-474b-8727-1bb409886875 req-1affb4f5-7b98-4353-b866-b81c0ae42ffa service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 HTTP/1.1" status: 200 len: 853 time: 0.0506372 Nov 12 15:02:29.819079 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd9332b0-071d-474b-8727-1bb409886875 req-f43f83ae-5f82-4387-baaa-06c4d75dc90d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:29.820455 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dd9332b0-071d-474b-8727-1bb409886875 req-f43f83ae-5f82-4387-baaa-06c4d75dc90d service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0414436 Nov 12 15:02:29.866860 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Deleting port 96d08a96-6fb3-4e3c-ba24-6415cf0258cf {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:29.867198 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.914144 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dd9332b0-071d-474b-8727-1bb409886875 req-c7f74f8f-8556-41f4-95a8-b80b1e0bf5ac service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862668 Nov 12 15:02:29.940985 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.941302 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:29.952749 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Calling delete_port for 96d08a96-6fb3-4e3c-ba24-6415cf0258cf owned by network:floatingip {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:30.008361 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-dd9332b0-071d-474b-8727-1bb409886875 req-68dae468-9bea-4048-924c-e340ef236fae service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860286 Nov 12 15:02:30.129693 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:30.157755 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event deleted for resources: {'Port': ['ID=96d08a96-6fb3-4e3c-ba24-6415cf0258cf,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:30.215534 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks [] for floatingip, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:30.215858 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.l3_db [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Floating IP 337c87a7-17f3-4142-8ac8-7c86a74bcfa4 disassociated (deleted). External IP: 172.27.3.215, port: 37ce8a4b-01d0-4c8c-8665-8f6627848b39. Nov 12 15:02:30.419286 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Router bd049b89-6c39-46a2-a0d7-61445958d280 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:02:30.526373 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:02:30.531229 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:30.535765 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] Sync routers for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:02:30.545278 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:30.545888 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:30.558064 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-3e2ef957-ed70-4cc5-8687-ecc6feca8a4a tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "DELETE /v2.0/floatingips/337c87a7-17f3-4142-8ac8-7c86a74bcfa4 HTTP/1.1" status: 204 len: 168 time: 0.8926134 Nov 12 15:02:30.655537 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:30.709246 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d988fa-60da-4409-8841-5a8fe7ecba6e req-fe024b36-6461-4536-b586-76aa49b8e1f7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:30.710847 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-06d988fa-60da-4409-8841-5a8fe7ecba6e req-fe024b36-6461-4536-b586-76aa49b8e1f7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 944 time: 0.0531681 Nov 12 15:02:30.767387 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-06d988fa-60da-4409-8841-5a8fe7ecba6e req-1f193322-b950-4edb-b1f9-41c6a2558268 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501003 Nov 12 15:02:30.875349 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 5, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:30.904878 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] Checking router: bd049b89-6c39-46a2-a0d7-61445958d280 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:02:30.913998 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:30.914610 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:31.008648 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 80209aed-5240-4dda-915c-40b00a2280c7 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:31.018710 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:31.058022 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 80209aed-5240-4dda-915c-40b00a2280c7 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:02:31.064383 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 80209aed-5240-4dda-915c-40b00a2280c7 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:31.064832 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:31.144565 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:31.181264 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '55ae80dd-c881-495d-b393-37f714977cb2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80209aed-5240-4dda-915c-40b00a2280c7'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:02:31.183535 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3537fc4-cbea-4769-92ee-d3acded63da5" -d '{"events": [{"server_uuid": "55ae80dd-c881-495d-b393-37f714977cb2", "name": "network-vif-plugged", "status": "completed", "tag": "80209aed-5240-4dda-915c-40b00a2280c7"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:31.199679 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 80209aed-5240-4dda-915c-40b00a2280c7, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=80209aed-5240-4dda-915c-40b00a2280c7,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:31.205851 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:31.234016 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:02:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42f53726-cc99-43f5-b204-a576add57a05 x-openstack-request-id: req-42f53726-cc99-43f5-b204-a576add57a05 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:31.234345 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "55ae80dd-c881-495d-b393-37f714977cb2", "name": "network-vif-plugged", "status": "completed", "tag": "80209aed-5240-4dda-915c-40b00a2280c7", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:31.235148 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-42f53726-cc99-43f5-b204-a576add57a05 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:31.235556 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '55ae80dd-c881-495d-b393-37f714977cb2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80209aed-5240-4dda-915c-40b00a2280c7', 'code': 200} Nov 12 15:02:31.262521 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=80209aed-5240-4dda-915c-40b00a2280c7,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:31.280312 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39'}] {{(pid=101617) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:02:31.283154 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a89741189a1474522a3f12d6512a4dfa907db76ed85a3c525a03538a87d7317" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-97571f68-f83d-4e0e-8e1b-50e864ca88a2" -d '{"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39"}]}' {{(pid=101617) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:31.322667 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 5, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:31.332533 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:02:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3ded794-17b9-4b09-9167-e80dddfdf71f x-openstack-request-id: req-d3ded794-17b9-4b09-9167-e80dddfdf71f {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:31.332824 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39", "status": "completed", "code": 200}]} {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:31.333103 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-d3ded794-17b9-4b09-9167-e80dddfdf71f {{(pid=101617) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:31.333502 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'status': 'completed', 'code': 200} Nov 12 15:02:31.349949 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7bc8868-e9d7-411d-b907-3e5a9db18575 None None] The sync data for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi is: [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T14:59:54Z', 'revision_number': 4, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '74454b28-10e6-472e-9310-ea7a4e5be254', 'name': '', 'network_id': 'fb9a4b4b-b9a5-4585-a360-1f294aeb3903', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'mac_address': 'fa:16:3e:fe:37:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_interface', 'standard_attr_id': 466, 'fixed_ips': [{'subnet_id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:53Z', 'updated_at': '2021-11-12T14:59:59Z', 'revision_number': 5, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'subnets': [{'id': 'f4fb6dc5-7523-48a4-a992-01a08cf2fcf4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:02:31.442628 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-c5d44d54-2698-47ee-a22f-e8b8216a0cd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:31.444140 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-c5d44d54-2698-47ee-a22f-e8b8216a0cd9 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 1098 time: 0.0773964 Nov 12 15:02:31.446843 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72a281c2-9ae6-4108-8f98-5c2a206792b5 req-a8308864-ea9e-460f-a4f3-4f6c4d782011 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:31.448236 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-72a281c2-9ae6-4108-8f98-5c2a206792b5 req-a8308864-ea9e-460f-a4f3-4f6c4d782011 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 1098 time: 0.0732949 Nov 12 15:02:31.554043 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-72a281c2-9ae6-4108-8f98-5c2a206792b5 req-c5a39b1d-8c88-403c-b41b-4fcb3172e4a6 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0906444 Nov 12 15:02:31.575083 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-93646546-7efd-4ddc-a92a-57d9649740a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:31.576656 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-93646546-7efd-4ddc-a92a-57d9649740a7 service neutron] 10.222.0.86 "GET /v2.0/networks?id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 200 len: 915 time: 0.1204875 Nov 12 15:02:31.592062 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fec3b04e-603d-4651-9bf9-e48e3dc1e784 None None] New status for floating IP 337c87a7-17f3-4142-8ac8-7c86a74bcfa4: DOWN {{(pid=101619) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:02:31.791445 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-44e8e3f1-f034-4a5f-a40d-f345581b1120 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 200 len: 217 time: 0.0394597 Nov 12 15:02:31.845498 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-ad989f17-69f5-4cbf-a1ba-50a026a48d88 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:31.847052 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-ad989f17-69f5-4cbf-a1ba-50a026a48d88 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 HTTP/1.1" status: 200 len: 853 time: 0.0484979 Nov 12 15:02:31.929560 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff66472-5f5b-4ac9-bd8a-641b69f52f85 req-c7cdaac7-aa96-4599-90fb-4d2a4b4b74ba tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:31.931023 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aff66472-5f5b-4ac9-bd8a-641b69f52f85 req-c7cdaac7-aa96-4599-90fb-4d2a4b4b74ba tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 945 time: 0.0803647 Nov 12 15:02:31.933828 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-b731d974-3d56-42f8-ab08-0408989de0b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:31.935181 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-b731d974-3d56-42f8-ab08-0408989de0b5 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=fb9a4b4b-b9a5-4585-a360-1f294aeb3903&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0741267 Nov 12 15:02:32.036207 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aff66472-5f5b-4ac9-bd8a-641b69f52f85 req-23108a1e-dcf0-4156-bcf6-a1d0666028ab tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0984807 Nov 12 15:02:32.063175 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-4194fdac-ba2a-42df-ba9f-b8896c47c66a service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1089597 Nov 12 15:02:32.154479 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-97571f68-f83d-4e0e-8e1b-50e864ca88a2 req-1b56df40-120d-4eb8-8917-d36b44a5227f service neutron] 10.222.0.86 "GET /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866055 Nov 12 15:02:33.156472 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe8df58e-20dd-406b-be9a-cd7dd38f912d req-1858cbfc-6f7a-48e2-9e9f-879555c7d43d tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:33.158159 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fe8df58e-20dd-406b-be9a-cd7dd38f912d req-1858cbfc-6f7a-48e2-9e9f-879555c7d43d tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 945 time: 0.0494606 Nov 12 15:02:33.215813 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fe8df58e-20dd-406b-be9a-cd7dd38f912d req-ebd4995a-690f-434b-8259-11b5e6a27541 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507643 Nov 12 15:02:33.302088 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf06df2-2d06-46b6-94c7-6f904a149037 req-f0738325-908c-4172-af6a-f642a2cd4bfb tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:33.303545 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5bf06df2-2d06-46b6-94c7-6f904a149037 req-f0738325-908c-4172-af6a-f642a2cd4bfb tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 945 time: 0.0490615 Nov 12 15:02:33.353321 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5bf06df2-2d06-46b6-94c7-6f904a149037 req-bec8a51a-8804-421b-a758-43149ffb1c00 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435824 Nov 12 15:02:34.473723 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6667992c-fc2f-40db-b116-daf2a859d602 req-3b21c901-3d20-49fe-9298-818c9155d84f tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:34.475231 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6667992c-fc2f-40db-b116-daf2a859d602 req-3b21c901-3d20-49fe-9298-818c9155d84f tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 945 time: 0.0493500 Nov 12 15:02:34.523888 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6667992c-fc2f-40db-b116-daf2a859d602 req-636dea98-6b8d-41df-afa9-53175fbc19ba tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/security-groups?id=407a8ee7-48fd-4e47-a4e0-23203c0a793d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426614 Nov 12 15:02:34.989889 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:35.088783 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-7037c0fa-41b9-4497-81a6-88c8ac170d9d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:35.090208 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-7037c0fa-41b9-4497-81a6-88c8ac170d9d tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.86 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 945 time: 0.0475163 Nov 12 15:02:35.186490 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Deleting port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:35.186902 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:35.279028 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] For port 37ce8a4b-01d0-4c8c-8665-8f6627848b39, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=37ce8a4b-01d0-4c8c-8665-8f6627848b39,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:35.279382 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:35.291448 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Calling delete_port for 37ce8a4b-01d0-4c8c-8665-8f6627848b39 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:35.414856 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:35.426755 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['37ce8a4b-01d0-4c8c-8665-8f6627848b39'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:02:35.441280 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Pushing event deleted for resources: {'Port': ['ID=37ce8a4b-01d0-4c8c-8665-8f6627848b39,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:35.499917 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] No DVR routers for this DVR port 37ce8a4b-01d0-4c8c-8665-8f6627848b39 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:02:35.502591 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:35.506040 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6580f7aa-b158-47b4-9b96-dd599202f3f2 req-71fe42ca-740f-4e5f-9a5f-4f2b5470b910 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.86 "DELETE /v2.0/ports/37ce8a4b-01d0-4c8c-8665-8f6627848b39 HTTP/1.1" status: 204 len: 173 time: 0.4095161 Nov 12 15:02:35.506497 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'name': 'network-vif-deleted', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:02:35.508847 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3b78cb62-82e0-4a03-86f3-b80c69fb6748" -d '{"events": [{"server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "name": "network-vif-deleted", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:35.548391 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:02:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c7ae1e2-bc40-4c08-82b7-f99fa02b4dc9 x-openstack-request-id: req-0c7ae1e2-bc40-4c08-82b7-f99fa02b4dc9 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:35.548688 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8faa020b-89ad-4460-a161-eb7444c4afd9", "name": "network-vif-deleted", "tag": "37ce8a4b-01d0-4c8c-8665-8f6627848b39", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:35.548941 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-0c7ae1e2-bc40-4c08-82b7-f99fa02b4dc9 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:35.549404 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8faa020b-89ad-4460-a161-eb7444c4afd9', 'name': 'network-vif-deleted', 'tag': '37ce8a4b-01d0-4c8c-8665-8f6627848b39', 'status': 'completed', 'code': 200} Nov 12 15:02:35.637340 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a9f9a858-d02f-440c-ae46-2bd4d478275b req-764ab366-09e2-4f05-ae39-106c7e42e5a2 tempest-TestMinimumBasicScenario-480175549 tempest-TestMinimumBasicScenario-480175549-project] 10.222.0.61 "GET /v2.0/ports?device_id=8faa020b-89ad-4460-a161-eb7444c4afd9 HTTP/1.1" status: 200 len: 210 time: 0.0274780 Nov 12 15:02:38.188419 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33506) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:38.532603 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1754847'] for router_interface, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:38.767515 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Deleting port 74454b28-10e6-472e-9310-ea7a4e5be254 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:38.767836 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:38.845364 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] For port 74454b28-10e6-472e-9310-ea7a4e5be254, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=74454b28-10e6-472e-9310-ea7a4e5be254,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:38.845743 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:38.858009 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Calling delete_port for 74454b28-10e6-472e-9310-ea7a4e5be254 owned by network:router_interface {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:39.037420 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:39.063440 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Pushing event deleted for resources: {'Port': ['ID=74454b28-10e6-472e-9310-ea7a4e5be254,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:39.099598 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 37ce8a4b-01d0-4c8c-8665-8f6627848b39 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:39.123708 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 37ce8a4b-01d0-4c8c-8665-8f6627848b39 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:39.124337 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 37ce8a4b-01d0-4c8c-8665-8f6627848b39 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:39.248562 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611175', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1753199'] for router_interface, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:39.699879 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Router bd049b89-6c39-46a2-a0d7-61445958d280 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:02:39.808420 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:02:39.817192 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-c0c5964d-57f2-4bbe-97b1-78b7766572bc admin admin] 10.222.0.61 "PUT /v2.0/routers/bd049b89-6c39-46a2-a0d7-61445958d280/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6275928 Nov 12 15:02:39.819650 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] Sync routers for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:02:39.820188 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33512) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:39.831163 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:39.831789 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:39.931313 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks [] for router, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:39.948585 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:40.035464 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.098078 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Deleting port b3007359-aa15-4e33-84a7-316b751dbbae {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:40.098670 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.140014 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200'}], 'enable_snat': True}, 'gw_port_id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T15:02:38Z', 'revision_number': 5, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port': {'id': 'b3007359-aa15-4e33-84a7-316b751dbbae', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:1f:e1:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'device_owner': 'network:router_gateway', 'standard_attr_id': 465, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.200', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:52Z', 'updated_at': '2021-11-12T14:59:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:40.168043 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] Checking router: bd049b89-6c39-46a2-a0d7-61445958d280 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:02:40.178164 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] Routers {'bd049b89-6c39-46a2-a0d7-61445958d280'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:40.178809 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['bd049b89-6c39-46a2-a0d7-61445958d280'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:40.193308 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] For port b3007359-aa15-4e33-84a7-316b751dbbae, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=b3007359-aa15-4e33-84a7-316b751dbbae,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:40.193698 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.208904 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Calling delete_port for b3007359-aa15-4e33-84a7-316b751dbbae owned by network:router_gateway {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:40.268101 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] Set router bd049b89-6c39-46a2-a0d7-61445958d280 gateway port host: None {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:40.331473 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T15:02:40Z', 'revision_number': 6, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port_host': None}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:40.358567 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6b2d7d9-d23a-49ef-8fbb-ee0358b95364 None None] The sync data for ids ['bd049b89-6c39-46a2-a0d7-61445958d280'] in dv-cinder-776422-5-iscsi is: [{'id': 'bd049b89-6c39-46a2-a0d7-61445958d280', 'name': 'tempest-TestMinimumBasicScenario-351754592-router', 'tenant_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:51Z', 'updated_at': '2021-11-12T15:02:40Z', 'revision_number': 6, 'project_id': '081b60b81cf04cd28b26a5b5cf5d5888', 'gw_port_host': None}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:02:40.399965 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.430628 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Pushing event deleted for resources: {'Port': ['ID=b3007359-aa15-4e33-84a7-316b751dbbae,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:40.495855 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1760149'] for router_gateway, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.588293 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1755136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-43439'] for router, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.590560 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.634199 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1755257'] for router, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.634726 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router bd049b89-6c39-46a2-a0d7-61445958d280 {{(pid=101617) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 12 15:02:40.639409 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] Publish callbacks [] for router, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.641104 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-b6ec58f4-fd07-40e1-bb5f-547568a26fb0 admin admin] 10.222.0.61 "DELETE /v2.0/routers/bd049b89-6c39-46a2-a0d7-61445958d280 HTTP/1.1" status: 204 len: 168 time: 0.8194661 Nov 12 15:02:40.643574 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33516) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:40.692543 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-c189229a-2fb0-4c3c-a7f9-cc37267e4f09 admin admin] Deleting subnet f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:02:40.696027 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c189229a-2fb0-4c3c-a7f9-cc37267e4f09 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.736496 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c189229a-2fb0-4c3c-a7f9-cc37267e4f09 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.822869 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c189229a-2fb0-4c3c-a7f9-cc37267e4f09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.876796 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c189229a-2fb0-4c3c-a7f9-cc37267e4f09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.907431 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c189229a-2fb0-4c3c-a7f9-cc37267e4f09 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f4fb6dc5-7523-48a4-a992-01a08cf2fcf4,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:40.912571 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c189229a-2fb0-4c3c-a7f9-cc37267e4f09 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:40.916627 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-c189229a-2fb0-4c3c-a7f9-cc37267e4f09 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/f4fb6dc5-7523-48a4-a992-01a08cf2fcf4 HTTP/1.1" status: 204 len: 168 time: 0.2720366 Nov 12 15:02:40.918214 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a66381b-cd9b-47ff-bae4-268a161f2bb8 None None] Network fb9a4b4b-b9a5-4585-a360-1f294aeb3903 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:02:40.919110 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33518) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:40.991450 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.048451 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Deleting port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:41.048845 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.127793 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] For port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e,segment=NetworkSegment(7219405f-f48a-498b-8c75-af2c335a831e),segment_id=7219405f-f48a-498b-8c75-af2c335a831e)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:41.128194 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.145284 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Calling delete_port for 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e owned by network:dhcp {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:41.170200 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] DHCP port deletion for fb9a4b4b-b9a5-4585-a360-1f294aeb3903 request from dv-cinder-776422-5-iscsi {{(pid=101619) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 12 15:02:41.254421 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device b3007359-aa15-4e33-84a7-316b751dbbae no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:41.257102 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] Deleting port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e {{(pid=101619) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:41.257475 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.265174 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.295261 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: b3007359-aa15-4e33-84a7-316b751dbbae {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:41.295261 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device b3007359-aa15-4e33-84a7-316b751dbbae not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:41.295535 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 74454b28-10e6-472e-9310-ea7a4e5be254 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:41.305052 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] No DVR routers for this DVR port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e on host dv-cinder-776422-5-iscsi {{(pid=101617) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:02:41.307304 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Pushing event deleted for resources: {'Port': ['ID=8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:41.345126 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 74454b28-10e6-472e-9310-ea7a4e5be254 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:41.345466 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 74454b28-10e6-472e-9310-ea7a4e5be254 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:41.346080 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:41.376771 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:41.377029 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:41.384414 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] For port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e, host dv-cinder-776422-5-iscsi, got binding levels [] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:41.384818 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.390693 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.398603 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] Calling delete_port for 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e owned by network:dhcp {{(pid=101619) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:41.401794 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.ipam_backend_mixin [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] Port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e was not found and therefore no delete operation was performed {{(pid=101619) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 12 15:02:41.403106 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.415994 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fb9a4b4b-b9a5-4585-a360-1f294aeb3903']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:41.427980 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7219405f-f48a-498b-8c75-af2c335a831e') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:41.428393 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7219405f-f48a-498b-8c75-af2c335a831e') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:41.430463 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] Pushing event deleted for resources: {'Port': ['ID=8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e,revision_number=None']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:41.435065 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d2050ff-24bf-43dc-97ba-3ad0a645075b None None] No DVR routers for this DVR port 8e39b9c2-9e07-4fdd-b2c9-bed82e94de4e on host dv-cinder-776422-5-iscsi {{(pid=101619) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:02:41.442444 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.462359 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.469286 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Releasing vlan 614 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:02:41.469694 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:02:41.471429 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:02:41.533578 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.538943 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:41.542375 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] 10.222.0.61 "DELETE /v2.0/networks/fb9a4b4b-b9a5-4585-a360-1f294aeb3903 HTTP/1.1" status: 204 len: 168 time: 0.6222577 Nov 12 15:02:41.545434 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33522) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:41.553392 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ca0856-eff3-49f4-8efe-14ef41385ac5 admin admin] Pushing event deleted for resources: {'Network': ['ID=fb9a4b4b-b9a5-4585-a360-1f294aeb3903,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:41.967653 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1754847'] for router_interface, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:42.502161 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Deleting port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:42.502492 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:42.572349 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-1706ffab-697c-4c38-9464-2f5d69682887 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:42.573750 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-1706ffab-697c-4c38-9464-2f5d69682887 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 815 time: 0.1048071 Nov 12 15:02:42.581539 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] For port 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=8f9fcefe-e0b6-4098-b5b7-db33570e1fd2,segment=NetworkSegment(9264d629-34c9-4a63-8c7e-91fb364a4875),segment_id=9264d629-34c9-4a63-8c7e-91fb364a4875)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:42.582059 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:42.589245 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-8e5186e3-4fef-490c-933e-a7d245c657e2 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/quotas/4a3b37db0a5944228023e883b9a67692 HTTP/1.1" status: 200 len: 375 time: 0.0092492 Nov 12 15:02:42.594599 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Calling delete_port for 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 owned by network:router_interface {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:42.638420 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3e5f92a0-4ea2-4802-9324-d82645287d57 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0435474 Nov 12 15:02:42.727759 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-a46ac2f0-86a7-4675-adba-dfb3736d766c service neutron] 10.222.0.61 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808175 Nov 12 15:02:42.776764 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:42.814032 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Pushing event deleted for resources: {'Port': ['ID=8f9fcefe-e0b6-4098-b5b7-db33570e1fd2,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:42.824592 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-0e5b532b-3914-47ae-9926-7887eb387ccb service neutron] 10.222.0.61 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0909741 Nov 12 15:02:43.023487 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5c148495-cffb-44a9-a48a-fb491c4f1fb9 req-5fd63a54-8ad4-44b7-b41d-05e3c12ecf49 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 210 time: 0.0352488 Nov 12 15:02:43.052519 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611175', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1753199'] for router_interface, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:43.287195 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Router 1b7beec1-89da-42c3-9717-c12a2e772716 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:02:43.399337 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:02:43.407140 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-1c6a65b3-8189-4e85-b4b7-a4487ff100b0 admin admin] 10.222.0.61 "PUT /v2.0/routers/1b7beec1-89da-42c3-9717-c12a2e772716/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8574536 Nov 12 15:02:43.407263 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33550) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:43.411027 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] Sync routers for ids ['1b7beec1-89da-42c3-9717-c12a2e772716'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:02:43.420719 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] Routers {'1b7beec1-89da-42c3-9717-c12a2e772716'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:43.421594 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['1b7beec1-89da-42c3-9717-c12a2e772716'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:43.517589 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks [] for router, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:43.539321 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] Set router 1b7beec1-89da-42c3-9717-c12a2e772716 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:43.625354 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:43.678991 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Deleting port 275878ff-09ad-463b-b346-da1cd1f8b9ad {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:43.679321 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:43.718396 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158'}], 'enable_snat': True}, 'gw_port_id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T15:02:42Z', 'revision_number': 5, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'gw_port': {'id': '275878ff-09ad-463b-b346-da1cd1f8b9ad', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:93:be', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T15:00:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:43.744619 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] Checking router: 1b7beec1-89da-42c3-9717-c12a2e772716 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:02:43.753051 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] Routers {'1b7beec1-89da-42c3-9717-c12a2e772716'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:43.753650 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['1b7beec1-89da-42c3-9717-c12a2e772716'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:43.757450 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] For port 275878ff-09ad-463b-b346-da1cd1f8b9ad, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=275878ff-09ad-463b-b346-da1cd1f8b9ad,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:43.757810 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:43.775407 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Calling delete_port for 275878ff-09ad-463b-b346-da1cd1f8b9ad owned by network:router_gateway {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:43.842975 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] Set router 1b7beec1-89da-42c3-9717-c12a2e772716 gateway port host: None {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:43.898372 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T15:02:43Z', 'revision_number': 6, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'gw_port_host': None}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:43.927769 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ec65b88-e095-4a0c-9a72-58ad65d52d3d None None] The sync data for ids ['1b7beec1-89da-42c3-9717-c12a2e772716'] in dv-cinder-776422-5-iscsi is: [{'id': '1b7beec1-89da-42c3-9717-c12a2e772716', 'name': 'tempest-TestMinimumBasicScenario-1694409861-router', 'tenant_id': '697591285a6e44daa3000fca1ccf7e4a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:59:56Z', 'updated_at': '2021-11-12T15:02:43Z', 'revision_number': 6, 'project_id': '697591285a6e44daa3000fca1ccf7e4a', 'gw_port_host': None}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:02:44.053228 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-d002a711-7ddf-48e5-b89a-464f0fd50704 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:44.054301 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-d002a711-7ddf-48e5-b89a-464f0fd50704 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 815 time: 0.1639941 Nov 12 15:02:44.061882 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.095711 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Request body: {'port': {'device_id': 'fa4a8913-d092-41fa-ba8e-037034fa36ca', 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381', 'admin_state_up': True, 'tenant_id': '4a3b37db0a5944228023e883b9a67692'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:44.102457 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Pushing event deleted for resources: {'Port': ['ID=275878ff-09ad-463b-b346-da1cd1f8b9ad,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:44.123886 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f3053252-b6c0-4fe2-ab07-759e96e5dbc7 req-ff14c2b0-9857-4fd8-9df8-972292ff8d41 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 210 time: 0.0299037 Nov 12 15:02:44.227648 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1760149'] for router_gateway, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.335343 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:02:44.345248 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1755136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-43439'] for router, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.347924 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.417280 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Made reservation on behalf of 4a3b37db0a5944228023e883b9a67692 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:02:44.420942 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.424560 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1755257'] for router, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.425064 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1b7beec1-89da-42c3-9717-c12a2e772716 {{(pid=101618) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 12 15:02:44.430003 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.431090 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-8ee6828c-c25c-4c0d-9a16-47e9f8050e71 admin admin] 10.222.0.61 "DELETE /v2.0/routers/1b7beec1-89da-42c3-9717-c12a2e772716 HTTP/1.1" status: 204 len: 168 time: 1.0229676 Nov 12 15:02:44.433734 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33558) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:44.477432 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-0d8904d1-0d19-4e60-beb2-a9a177592ed1 admin admin] Deleting subnet 39333609-040c-402e-935a-d3f3817a37b2 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:02:44.480532 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0d8904d1-0d19-4e60-beb2-a9a177592ed1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.519717 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0d8904d1-0d19-4e60-beb2-a9a177592ed1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.557022 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Allocated IP 172.20.0.10 (b3def5d6-542f-430c-929b-c115bf33a381/6c234914-5201-4acb-90e6-43368a9bb837/d7aa8b81-78d7-4f77-a972-d37582c3137e) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:02:44.596945 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0d8904d1-0d19-4e60-beb2-a9a177592ed1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.649741 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0d8904d1-0d19-4e60-beb2-a9a177592ed1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.677123 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d8904d1-0d19-4e60-beb2-a9a177592ed1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=39333609-040c-402e-935a-d3f3817a37b2,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:44.680959 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-0d8904d1-0d19-4e60-beb2-a9a177592ed1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.686631 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-0d8904d1-0d19-4e60-beb2-a9a177592ed1 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/39333609-040c-402e-935a-d3f3817a37b2 HTTP/1.1" status: 204 len: 168 time: 0.2494652 Nov 12 15:02:44.686927 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33560) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:44.691332 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42af4026-d6b3-4e14-8298-10c68f08753e None None] Network 36029b5a-89ee-422a-a728-17855197aded requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:02:44.728184 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.766126 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.770013 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.779940 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['80209aed-5240-4dda-915c-40b00a2280c7'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:02:44.813635 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Network b3def5d6-542f-430c-929b-c115bf33a381 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:44.819372 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:44.828913 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:02:44.833693 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Deleting port 319eddac-ea17-4267-82f4-b437b8ffbb93 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:44.834225 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.836590 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Pushing event updated for resources: {'Port': ['ID=d7aa8b81-78d7-4f77-a972-d37582c3137e,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:44.892869 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:44.893608 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.911225 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-3df29981-cb70-4dac-9c49-c2425cea334e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8437347 Nov 12 15:02:44.926059 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Request body: {'port': {'device_id': 'fa4a8913-d092-41fa-ba8e-037034fa36ca', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:44.932691 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] For port 319eddac-ea17-4267-82f4-b437b8ffbb93, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=319eddac-ea17-4267-82f4-b437b8ffbb93,segment=NetworkSegment(9264d629-34c9-4a63-8c7e-91fb364a4875),segment_id=9264d629-34c9-4a63-8c7e-91fb364a4875)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:44.933058 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:44.957001 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Calling delete_port for 319eddac-ea17-4267-82f4-b437b8ffbb93 owned by network:dhcp {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:44.978471 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] DHCP port deletion for 36029b5a-89ee-422a-a728-17855197aded request from dv-cinder-776422-5-iscsi {{(pid=101619) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 12 15:02:45.010244 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.018597 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:45.051762 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:45.052231 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 8f9fcefe-e0b6-4098-b5b7-db33570e1fd2 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:45.052904 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 275878ff-09ad-463b-b346-da1cd1f8b9ad no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:45.061380 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.082761 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 275878ff-09ad-463b-b346-da1cd1f8b9ad {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:45.083165 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 275878ff-09ad-463b-b346-da1cd1f8b9ad not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:45.093449 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Pushing event deleted for resources: {'Port': ['ID=319eddac-ea17-4267-82f4-b437b8ffbb93,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:45.102565 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] No DVR routers for this DVR port 319eddac-ea17-4267-82f4-b437b8ffbb93 on host dv-cinder-776422-5-iscsi {{(pid=101617) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:02:45.107767 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] Deleting port 319eddac-ea17-4267-82f4-b437b8ffbb93 {{(pid=101619) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:02:45.108257 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.193726 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.194567 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] For port 319eddac-ea17-4267-82f4-b437b8ffbb93, host dv-cinder-776422-5-iscsi, got binding levels [] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:45.194977 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.211213 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] Calling delete_port for 319eddac-ea17-4267-82f4-b437b8ffbb93 owned by network:dhcp {{(pid=101619) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:02:45.214136 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.ipam_backend_mixin [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] Port 319eddac-ea17-4267-82f4-b437b8ffbb93 was not found and therefore no delete operation was performed {{(pid=101619) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 12 15:02:45.215502 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.219116 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['36029b5a-89ee-422a-a728-17855197aded']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:45.229764 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9264d629-34c9-4a63-8c7e-91fb364a4875') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:45.230058 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9264d629-34c9-4a63-8c7e-91fb364a4875') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:45.241666 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] Pushing event deleted for resources: {'Port': ['ID=319eddac-ea17-4267-82f4-b437b8ffbb93,revision_number=None']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:45.243713 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.246329 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58087c98-2e97-413a-a1cc-51206f3f88d5 None None] No DVR routers for this DVR port 319eddac-ea17-4267-82f4-b437b8ffbb93 on host dv-cinder-776422-5-iscsi {{(pid=101619) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:02:45.264934 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.276534 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Releasing vlan 605 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:02:45.276929 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:02:45.283260 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:02:45.314983 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dece0f9-146b-40be-b7d3-077cf0464bf9 req-c8ad2570-3b93-4aea-a9e3-a92e5e73358f tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:45.316528 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6dece0f9-146b-40be-b7d3-077cf0464bf9 req-c8ad2570-3b93-4aea-a9e3-a92e5e73358f tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 932 time: 0.1091671 Nov 12 15:02:45.338782 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.344966 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.348197 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] 10.222.0.61 "DELETE /v2.0/networks/36029b5a-89ee-422a-a728-17855197aded HTTP/1.1" status: 204 len: 168 time: 0.6592042 Nov 12 15:02:45.358544 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b3a3dc-39af-42bd-bf88-cdc0434b7e3c admin admin] Pushing event deleted for resources: {'Network': ['ID=36029b5a-89ee-422a-a728-17855197aded,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:45.421808 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6dece0f9-146b-40be-b7d3-077cf0464bf9 req-63faa168-e3d5-4922-9a81-a183f35f703d tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0988939 Nov 12 15:02:45.431237 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d7aa8b81-78d7-4f77-a972-d37582c3137e {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:02:45.446646 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.466135 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Transition to ACTIVE for port object d7aa8b81-78d7-4f77-a972-d37582c3137e will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:02:45.466868 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33566) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:45.471818 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.506256 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-b7077766-256f-4078-8bb8-bb5d7b5ca681 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=081b60b81cf04cd28b26a5b5cf5d5888&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0382504 Nov 12 15:02:45.508804 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33568) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:45.525597 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Pushing event updated for resources: {'Port': ['ID=d7aa8b81-78d7-4f77-a972-d37582c3137e,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:45.558461 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-73c7d5f2-459b-432a-a7fa-33cce96acbb8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.580181 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-73c7d5f2-459b-432a-a7fa-33cce96acbb8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.590174 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Attempting to bind port d7aa8b81-78d7-4f77-a972-d37582c3137e on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:02:45.590509 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Attempting to bind port d7aa8b81-78d7-4f77-a972-d37582c3137e by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:02:45.590863 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Attempting to bind port d7aa8b81-78d7-4f77-a972-d37582c3137e on network b3def5d6-542f-430c-929b-c115bf33a381 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:45.595188 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Port d7aa8b81-78d7-4f77-a972-d37582c3137e on network b3def5d6-542f-430c-929b-c115bf33a381 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:02:45.595506 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Attempting to bind port d7aa8b81-78d7-4f77-a972-d37582c3137e on network b3def5d6-542f-430c-929b-c115bf33a381 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:45.600494 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 2, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:02:45.600834 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Checking segment: {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:45.601213 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Bound using segment: {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:02:45.601634 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Bound port: d7aa8b81-78d7-4f77-a972-d37582c3137e, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:02:45.601981 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.626286 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-73c7d5f2-459b-432a-a7fa-33cce96acbb8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.628998 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-73c7d5f2-459b-432a-a7fa-33cce96acbb8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.630167 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-73c7d5f2-459b-432a-a7fa-33cce96acbb8 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/407a8ee7-48fd-4e47-a4e0-23203c0a793d HTTP/1.1" status: 204 len: 168 time: 0.1204441 Nov 12 15:02:45.638284 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73c7d5f2-459b-432a-a7fa-33cce96acbb8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=407a8ee7-48fd-4e47-a4e0-23203c0a793d,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:45.680374 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] For port d7aa8b81-78d7-4f77-a972-d37582c3137e, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:02:45.683821 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] For port d7aa8b81-78d7-4f77-a972-d37582c3137e, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d7aa8b81-78d7-4f77-a972-d37582c3137e,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:02:45.692551 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.728583 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:45.729184 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:45.730569 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] 10.222.0.86 "PUT /v2.0/ports/d7aa8b81-78d7-4f77-a972-d37582c3137e HTTP/1.1" status: 200 len: 1094 time: 0.8105061 Nov 12 15:02:45.731008 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fa4a8913-d092-41fa-ba8e-037034fa36ca', 'tag': 'd7aa8b81-78d7-4f77-a972-d37582c3137e'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:02:45.733274 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3213d1b9-2f35-4766-8a3b-25914094c5e4" -d '{"events": [{"name": "network-changed", "server_uuid": "fa4a8913-d092-41fa-ba8e-037034fa36ca", "tag": "d7aa8b81-78d7-4f77-a972-d37582c3137e"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:45.759484 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a45fec-8464-4d15-8677-d4fc8c4c1307 service neutron] Pushing event updated for resources: {'Port': ['ID=d7aa8b81-78d7-4f77-a972-d37582c3137e,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:45.789957 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:02:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f776ddd-797f-457a-b17f-c28ad2736d4f x-openstack-request-id: req-7f776ddd-797f-457a-b17f-c28ad2736d4f {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:45.790253 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fa4a8913-d092-41fa-ba8e-037034fa36ca", "tag": "d7aa8b81-78d7-4f77-a972-d37582c3137e", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:45.790503 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-7f776ddd-797f-457a-b17f-c28ad2736d4f {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:45.790898 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fa4a8913-d092-41fa-ba8e-037034fa36ca', 'tag': 'd7aa8b81-78d7-4f77-a972-d37582c3137e', 'status': 'completed', 'code': 200} Nov 12 15:02:45.825876 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-36426bc1-4a19-4b56-80a3-2e6dd1326358 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:45.827360 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-36426bc1-4a19-4b56-80a3-2e6dd1326358 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 1097 time: 0.0511949 Nov 12 15:02:45.876389 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-2e107aff-90d5-4aef-abdc-d3a41130f818 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d7aa8b81-78d7-4f77-a972-d37582c3137e HTTP/1.1" status: 200 len: 217 time: 0.0381563 Nov 12 15:02:45.930440 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-fbf03e00-9df2-46b3-8973-7f5b6cd147cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:45.931740 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-fbf03e00-9df2-46b3-8973-7f5b6cd147cd service neutron] 10.222.0.86 "GET /v2.0/subnets?id=6c234914-5201-4acb-90e6-43368a9bb837 HTTP/1.1" status: 200 len: 855 time: 0.0460305 Nov 12 15:02:45.966816 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33576) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:45.967017 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-2e270e58-e61e-4f0f-8a83-3459748c9df4 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b3def5d6-542f-430c-929b-c115bf33a381&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251894 Nov 12 15:02:46.010193 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-20cf2f2b-2026-4402-8c9f-6be8ca91e021 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=697591285a6e44daa3000fca1ccf7e4a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0421686 Nov 12 15:02:46.013050 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33578) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:46.061110 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-96b126fd-11e8-4b79-ad07-e9d6ecddac84 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:46.062126 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-c6ae2b9c-0ee7-4e80-ab8b-68c2ecc5e590 service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877969 Nov 12 15:02:46.082767 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-96b126fd-11e8-4b79-ad07-e9d6ecddac84 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:46.128233 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-96b126fd-11e8-4b79-ad07-e9d6ecddac84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:46.130845 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-96b126fd-11e8-4b79-ad07-e9d6ecddac84 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:46.131980 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-96b126fd-11e8-4b79-ad07-e9d6ecddac84 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/cd8fce51-8d51-4868-aaa9-fab4a7261554 HTTP/1.1" status: 204 len: 168 time: 0.1178517 Nov 12 15:02:46.141271 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b126fd-11e8-4b79-ad07-e9d6ecddac84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd8fce51-8d51-4868-aaa9-fab4a7261554,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:46.170985 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c7b8d5ae-5094-4176-98c4-e10ba6b71367 req-aa8602fa-17bc-4228-8da3-2cd69a19798e service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1004145 Nov 12 15:02:46.256530 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-0c65d3a7-2ab2-4d69-9e20-979bb68ecf19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:46.258012 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-0c65d3a7-2ab2-4d69-9e20-979bb68ecf19 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 1097 time: 0.0423946 Nov 12 15:02:46.355831 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-f692ad6a-94f8-4938-9dbd-78e5ad16011c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:46.357365 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-f692ad6a-94f8-4938-9dbd-78e5ad16011c service neutron] 10.222.0.86 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 916 time: 0.0902190 Nov 12 15:02:46.402488 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-902eab69-f531-4bf0-baa1-e6bcaa1d83d3 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=d7aa8b81-78d7-4f77-a972-d37582c3137e HTTP/1.1" status: 200 len: 217 time: 0.0370097 Nov 12 15:02:46.457638 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-2dc56d85-eb28-4fbe-bc13-ad6f471fedb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:46.459517 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-2dc56d85-eb28-4fbe-bc13-ad6f471fedb9 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=6c234914-5201-4acb-90e6-43368a9bb837 HTTP/1.1" status: 200 len: 855 time: 0.0498438 Nov 12 15:02:46.748524 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-80d164cf-4986-460d-b95e-7d124f2e84a8 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b3def5d6-542f-430c-929b-c115bf33a381&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2773201 Nov 12 15:02:46.841748 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33602) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:46.852297 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2af33cf0-d5df-44af-931d-7976b56393cc req-fc47d75d-be0a-4ddb-9031-391bc0a46bf7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:46.853698 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2af33cf0-d5df-44af-931d-7976b56393cc req-fc47d75d-be0a-4ddb-9031-391bc0a46bf7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 944 time: 0.1075554 Nov 12 15:02:46.888799 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-d15ca753-10ba-4d2c-89d5-1842527d8ed7 service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1319458 Nov 12 15:02:46.895878 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 319eddac-ea17-4267-82f4-b437b8ffbb93 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:02:46.917615 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 319eddac-ea17-4267-82f4-b437b8ffbb93 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:02:46.918305 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 319eddac-ea17-4267-82f4-b437b8ffbb93 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:02:46.939369 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2af33cf0-d5df-44af-931d-7976b56393cc req-6a52b896-3ba7-4590-af1b-8c9bdd3deecb tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765858 Nov 12 15:02:46.954510 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-728810930-network', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:46.977318 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Made reservation on behalf of e0bd63a24fe9453c84dae6d5536c0df9 for: {'network': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:02:46.979832 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:46.988977 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.003609 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3213d1b9-2f35-4766-8a3b-25914094c5e4 req-7c177fb3-ae59-47dd-83ec-db72ce463292 service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1031401 Nov 12 15:02:47.064405 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.068257 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.094808 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 605} {{(pid=101617) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 15:02:47.100264 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0dd76a6a-423d-4052-8203-56dcfdc1e9dd,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:47.107571 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.107813 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.segments_db [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Added segment b5ad6a85-de19-49b7-8ae4-bab83ada0933 of type vlan for network 370662ef-db75-4207-9a43-c725449d1d6d Nov 12 15:02:47.148720 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.173264 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.174331 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:47.174939 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.205409 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.3607974 Nov 12 15:02:47.208368 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33606) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:47.213462 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Request body: {'subnet': {'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-728810930-subnet', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'ip_version': 4}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:47.233772 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Made reservation on behalf of e0bd63a24fe9453c84dae6d5536c0df9 for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:02:47.236269 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5528411'] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.236397 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fa97f93-457a-40bb-a0d0-9abf9542a741 admin admin] Pushing event updated for resources: {'Network': ['ID=370662ef-db75-4207-9a43-c725449d1d6d,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:47.245999 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 370662ef-db75-4207-9a43-c725449d1d6d details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 15:02:47.406665 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5822845', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5528393'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.457451 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Pushing event updated for resources: {'Subnet': ['ID=40c8c5f2-e714-4a04-9300-6f56d57e5158,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:47.467424 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Checking segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:47.467773 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Network hostable DHCP agents. Network: 370662ef-db75-4207-9a43-c725449d1d6d, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 15:02:47.484208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Network 370662ef-db75-4207-9a43-c725449d1d6d is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 15:02:47.492956 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 370662ef-db75-4207-9a43-c725449d1d6d) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:47.497776 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:47.498380 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.502351 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a2126ff-eebf-4ecb-a78b-20b86700e1ea None None] Network 370662ef-db75-4207-9a43-c725449d1d6d requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:02:47.515962 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-783ad2de-3c58-4056-a2a2-2476bbc6382c admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3058050 Nov 12 15:02:47.518974 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33608) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:47.524221 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:47.546275 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.547376 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.600919 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.661943 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-370662ef-db75-4207-9a43-c725449d1d6d', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 15:02:47.663048 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.741333 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.798678 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Allocated IP 172.20.0.2 (370662ef-db75-4207-9a43-c725449d1d6d/40c8c5f2-e714-4a04-9300-6f56d57e5158/4058c510-bc73-4949-b7de-e0149222edb8) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:02:47.939940 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.946085 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.947751 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:47.971899 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:48.073943 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c91005-67f5-404a-adf0-89d6fc9f2b9c req-e0b08a0d-e4ed-45a5-a452-3451da783f2a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:48.075590 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-15c91005-67f5-404a-adf0-89d6fc9f2b9c req-e0b08a0d-e4ed-45a5-a452-3451da783f2a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 944 time: 0.0524077 Nov 12 15:02:48.097422 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Allocated IP 172.27.3.60 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/0bc84d78-3052-42c6-b327-391df34810fb) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:02:48.123058 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Network 370662ef-db75-4207-9a43-c725449d1d6d is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:48.126722 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:48.130489 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-15c91005-67f5-404a-adf0-89d6fc9f2b9c req-67c33c88-383d-4213-acaf-5b10dc798db7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466945 Nov 12 15:02:48.131083 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:02:48.134218 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Pushing event updated for resources: {'Port': ['ID=4058c510-bc73-4949-b7de-e0149222edb8,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:48.185696 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Attempting to bind port 4058c510-bc73-4949-b7de-e0149222edb8 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:02:48.186231 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Attempting to bind port 4058c510-bc73-4949-b7de-e0149222edb8 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:02:48.186596 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Attempting to bind port 4058c510-bc73-4949-b7de-e0149222edb8 on network 370662ef-db75-4207-9a43-c725449d1d6d {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:48.192196 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 2, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:02:48.192508 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Checking segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:48.192905 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:48.193297 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Bound using segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:02:48.193770 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Bound port: 4058c510-bc73-4949-b7de-e0149222edb8, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:02:48.194128 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:48.219717 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:48.253710 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:48.259199 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] For port 4058c510-bc73-4949-b7de-e0149222edb8, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:02:48.262779 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] For port 4058c510-bc73-4949-b7de-e0149222edb8, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=4058c510-bc73-4949-b7de-e0149222edb8,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:02:48.266899 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:48.289471 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:48.292257 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:48.298429 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:02:48.325843 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Pushing event updated for resources: {'Port': ['ID=0bc84d78-3052-42c6-b327-391df34810fb,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:48.328046 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b07ef61-1872-42a4-9412-6ce626b5186c None None] Pushing event updated for resources: {'Port': ['ID=4058c510-bc73-4949-b7de-e0149222edb8,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:48.581667 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:48.786154 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:48.918942 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 4058c510-bc73-4949-b7de-e0149222edb8 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:48.945562 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Router 8ec4de9e-dbf9-4aec-bff5-67be839601cd is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101618) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 15:02:48.972921 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 4058c510-bc73-4949-b7de-e0149222edb8 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:48.973495 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.061299 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.068311 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:02:49.087719 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.087941 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Sync routers for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:02:49.090059 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-bd81d8d2-e17f-444f-92e7-71b3a3424af1 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 1.5701072 Nov 12 15:02:49.092730 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33612) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:49.106512 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:49.107361 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port 4058c510-bc73-4949-b7de-e0149222edb8, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=4058c510-bc73-4949-b7de-e0149222edb8,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:49.107636 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:49.114201 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.175440 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=4058c510-bc73-4949-b7de-e0149222edb8,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:49.191267 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d7aa8b81-78d7-4f77-a972-d37582c3137e details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:02:49.236639 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:49.304053 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8c8b34d-56e0-4ba2-8fe0-c1616b4eb2e4 None None] Network 370662ef-db75-4207-9a43-c725449d1d6d requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:02:49.363658 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e79e81e-8b01-45c3-8b73-da3a35ef2034 req-3e57264e-2fda-4be2-9d29-9bdce3b3b86f tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:49.365388 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0e79e81e-8b01-45c3-8b73-da3a35ef2034 req-3e57264e-2fda-4be2-9d29-9bdce3b3b86f tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 944 time: 0.1283851 Nov 12 15:02:49.377238 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d7aa8b81-78d7-4f77-a972-d37582c3137e, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d7aa8b81-78d7-4f77-a972-d37582c3137e,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:49.398460 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'd7aa8b81-78d7-4f77-a972-d37582c3137e', 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381', 'port_id': 'd7aa8b81-78d7-4f77-a972-d37582c3137e', 'mac_address': 'fa:16:3e:18:ad:ac', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 625, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6c234914-5201-4acb-90e6-43368a9bb837', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:02:49.471265 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:48Z', 'revision_number': 3, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:49.485531 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-2cf19c72-9b1f-4078-81a9-c998c5157cf4 None None] Provisioning complete for port 4058c510-bc73-4949-b7de-e0149222edb8 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:49.485903 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2cf19c72-9b1f-4078-81a9-c998c5157cf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.487489 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0e79e81e-8b01-45c3-8b73-da3a35ef2034 req-17264532-bf4c-49d6-853f-05549b5832e3 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905540 Nov 12 15:02:49.501342 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Checking router: 8ec4de9e-dbf9-4aec-bff5-67be839601cd for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:02:49.501342 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Updating router 8ec4de9e-dbf9-4aec-bff5-67be839601cd port 0bc84d78-3052-42c6-b327-391df34810fb binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 15:02:49.518362 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.528368 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.545607 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d7aa8b81-78d7-4f77-a972-d37582c3137e {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:02:49.595774 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d7aa8b81-78d7-4f77-a972-d37582c3137e, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d7aa8b81-78d7-4f77-a972-d37582c3137e,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:49.603306 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.699521 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=d7aa8b81-78d7-4f77-a972-d37582c3137e,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:49.706314 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.809225 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.815316 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.866248 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Pushing event updated for resources: {'Port': ['ID=0bc84d78-3052-42c6-b327-391df34810fb,revision_number=2']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:49.875289 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.875648 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.875985 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.876335 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.876674 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.876981 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.877297 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.877613 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.877942 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.878258 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.878568 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.878875 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101620) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:49.882366 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Attempting to bind port 0bc84d78-3052-42c6-b327-391df34810fb on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:02:49.882717 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Attempting to bind port 0bc84d78-3052-42c6-b327-391df34810fb by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:02:49.883072 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Attempting to bind port 0bc84d78-3052-42c6-b327-391df34810fb on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:49.888629 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 2, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:02:49.888997 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:49.889386 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.889758 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:02:49.890244 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Bound port: 0bc84d78-3052-42c6-b327-391df34810fb, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:02:49.890747 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.893847 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Allocated IP 172.20.0.1 (370662ef-db75-4207-9a43-c725449d1d6d/40c8c5f2-e714-4a04-9300-6f56d57e5158/e9bba504-b226-44cb-b431-8dd5e4840c85) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:02:49.917024 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['d7aa8b81-78d7-4f77-a972-d37582c3137e'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:02:49.957238 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] For port 0bc84d78-3052-42c6-b327-391df34810fb, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:02:49.960675 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-9172f2e1-360e-4c49-8364-208f82448ade None None] Provisioning complete for port 4058c510-bc73-4949-b7de-e0149222edb8 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:49.961149 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-9172f2e1-360e-4c49-8364-208f82448ade None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:49.962881 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] For port 0bc84d78-3052-42c6-b327-391df34810fb, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=0bc84d78-3052-42c6-b327-391df34810fb,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:02:49.970606 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:50.025560 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:50.031887 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:50.032357 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:50.068669 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:50.075374 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddbaf05b-6481-4cf4-905f-b1826fbfd9f5 None None] Pushing event updated for resources: {'Port': ['ID=0bc84d78-3052-42c6-b327-391df34810fb,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:50.113360 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Network 370662ef-db75-4207-9a43-c725449d1d6d is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:50.118698 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:50.121926 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:02:50.149492 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:50.159024 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Pushing event updated for resources: {'Port': ['ID=e9bba504-b226-44cb-b431-8dd5e4840c85,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:50.180336 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:50.313773 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:50.441432 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-f7f1abdd-b09b-413c-a6c7-1179b4c49906 None None] Provisioning complete for port e9bba504-b226-44cb-b431-8dd5e4840c85 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:50.442019 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f7f1abdd-b09b-413c-a6c7-1179b4c49906 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:50.451228 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:48Z', 'revision_number': 3, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:50.479610 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82ca399a-b013-42d4-b967-8feec31ccc0a None None] The sync data for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi is: [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:48Z', 'revision_number': 3, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:02:50.483454 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-f7f1abdd-b09b-413c-a6c7-1179b4c49906 None None] Port e9bba504-b226-44cb-b431-8dd5e4840c85 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:02:50.624080 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea734d80-b795-4cbc-a34f-ebade3477c5c req-a30d3ce5-cea3-4a9c-a257-68e3246f05d3 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:50.626774 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ea734d80-b795-4cbc-a34f-ebade3477c5c req-a30d3ce5-cea3-4a9c-a257-68e3246f05d3 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 945 time: 0.0574133 Nov 12 15:02:50.679538 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ea734d80-b795-4cbc-a34f-ebade3477c5c req-ff96b2ae-8769-4330-90db-ab416ce2c789 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466187 Nov 12 15:02:50.779793 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:50.784951 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:50.858355 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:50.864821 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Pushing event updated for resources: {'Port': ['ID=e9bba504-b226-44cb-b431-8dd5e4840c85,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:50.965140 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Network 370662ef-db75-4207-9a43-c725449d1d6d is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:50.966477 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:50.986660 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0bc84d78-3052-42c6-b327-391df34810fb up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:51.054420 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 0bc84d78-3052-42c6-b327-391df34810fb triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:51.055507 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.118081 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Router 8ec4de9e-dbf9-4aec-bff5-67be839601cd has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:02:51.150849 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.176264 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port 0bc84d78-3052-42c6-b327-391df34810fb, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=0bc84d78-3052-42c6-b327-391df34810fb,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:51.180580 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.181412 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 4058c510-bc73-4949-b7de-e0149222edb8 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:51.210822 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d7aa8b81-78d7-4f77-a972-d37582c3137e up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:51.256157 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:02:51.262171 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-02b21843-cd48-4d61-8e10-8a950f57e585 admin admin] 10.222.0.61 "PUT /v2.0/routers/8ec4de9e-dbf9-4aec-bff5-67be839601cd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1674411 Nov 12 15:02:51.314153 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=0bc84d78-3052-42c6-b327-391df34810fb,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:51.336635 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-f7c357e7-aba8-4b34-afd4-33dc0e745a0f None None] Provisioning complete for port e9bba504-b226-44cb-b431-8dd5e4840c85 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:51.336882 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f7c357e7-aba8-4b34-afd4-33dc0e745a0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.366431 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 4058c510-bc73-4949-b7de-e0149222edb8 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:51.366948 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.373268 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port d7aa8b81-78d7-4f77-a972-d37582c3137e completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:02:51.412323 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port d7aa8b81-78d7-4f77-a972-d37582c3137e triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:51.412695 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.438305 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-f7c357e7-aba8-4b34-afd4-33dc0e745a0f None None] Port e9bba504-b226-44cb-b431-8dd5e4840c85 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:02:51.540358 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.566661 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa4a8913-d092-41fa-ba8e-037034fa36ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7aa8b81-78d7-4f77-a972-d37582c3137e'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:02:51.568914 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-57e87c0f-1781-497c-81d8-60c860f3064c" -d '{"events": [{"server_uuid": "fa4a8913-d092-41fa-ba8e-037034fa36ca", "name": "network-vif-plugged", "status": "completed", "tag": "d7aa8b81-78d7-4f77-a972-d37582c3137e"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:02:51.589119 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port d7aa8b81-78d7-4f77-a972-d37582c3137e, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d7aa8b81-78d7-4f77-a972-d37582c3137e,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:51.594430 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.625965 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:02:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f878d59a-c6ea-4748-8640-d02d7054ce13 x-openstack-request-id: req-f878d59a-c6ea-4748-8640-d02d7054ce13 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:02:51.626276 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fa4a8913-d092-41fa-ba8e-037034fa36ca", "name": "network-vif-plugged", "status": "completed", "tag": "d7aa8b81-78d7-4f77-a972-d37582c3137e", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:02:51.626487 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f878d59a-c6ea-4748-8640-d02d7054ce13 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:02:51.626899 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fa4a8913-d092-41fa-ba8e-037034fa36ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7aa8b81-78d7-4f77-a972-d37582c3137e', 'code': 200} Nov 12 15:02:51.656609 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=d7aa8b81-78d7-4f77-a972-d37582c3137e,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:51.812954 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33638) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:51.817650 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1704084620-network', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:51.826132 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f319819f-7948-4307-90fe-5ac07e2ebf47 req-8c1cb3dc-fdbe-4370-87b4-4a2b4bfb79cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:51.828276 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f319819f-7948-4307-90fe-5ac07e2ebf47 req-8c1cb3dc-fdbe-4370-87b4-4a2b4bfb79cc service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 1099 time: 0.0590725 Nov 12 15:02:51.847306 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Made reservation on behalf of f745c341e1734c63bcdbbeac2e0cb4fd for: {'network': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:02:51.849656 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.859624 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf4e405-ab29-4de9-bca1-f8d91490807d req-d72762d9-e3e7-413b-9f5c-3014f06281fb tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:51.861155 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8cf4e405-ab29-4de9-bca1-f8d91490807d req-d72762d9-e3e7-413b-9f5c-3014f06281fb tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 946 time: 0.0764465 Nov 12 15:02:51.867046 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.877542 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f319819f-7948-4307-90fe-5ac07e2ebf47 req-17b7a1e1-3e28-423d-951e-0861eb845f61 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413415 Nov 12 15:02:51.938610 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8cf4e405-ab29-4de9-bca1-f8d91490807d req-1dcc1512-106d-4b2f-a270-898028a92034 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682805 Nov 12 15:02:51.985341 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:51.989246 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.019100 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 618} {{(pid=101617) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 15:02:52.024466 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fa7fcc7-eb7f-46eb-902e-a378c2f8a70b,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:52.033999 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.034461 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.segments_db [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Added segment b73d2421-3f63-48d8-9968-cd0326575a2e of type vlan for network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 Nov 12 15:02:52.077919 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.097746 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-fe7d9c2f-dd0e-4f4a-b932-9d1cad5b8519 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.107305 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.107305 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:52.107305 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.141044 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Sync routers for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:02:52.146689 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3302252 Nov 12 15:02:52.147186 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33640) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:52.150385 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:52.151027 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:52.152695 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Request body: {'subnet': {'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1704084620-subnet', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'ip_version': 4}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:52.174580 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Made reservation on behalf of f745c341e1734c63bcdbbeac2e0cb4fd for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:02:52.176698 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d4c9404-22ff-4a39-b77a-574d46fdcd36 admin admin] Pushing event updated for resources: {'Network': ['ID=9d4ba502-25f4-4402-adc5-0da53ae8c6f3,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:52.177256 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5528411'] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.189845 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 15:02:52.313877 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:52.352318 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5822845', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5528393'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.407845 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Pushing event updated for resources: {'Subnet': ['ID=fa62aa41-73bf-425b-8c66-b411b9d45c33,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:52.425232 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Checking segment: {'id': 'b73d2421-3f63-48d8-9968-cd0326575a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:52.426011 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Network hostable DHCP agents. Network: 9d4ba502-25f4-4402-adc5-0da53ae8c6f3, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 15:02:52.445837 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 15:02:52.456437 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 9d4ba502-25f4-4402-adc5-0da53ae8c6f3) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:52.460518 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:52.461115 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.467710 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9202a754-68bc-44d7-a4c6-d1a232504ffc None None] Network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:02:52.477435 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-9c4bf16f-0716-4429-b799-fc977bfb21ba admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3289406 Nov 12 15:02:52.480364 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33642) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:52.485840 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:52.506827 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1756334', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-43453'] for router, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.507850 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1755198', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1760100', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1808607', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-43446'] for router, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.564261 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.703993 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.759287 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 2, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:52.798985 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Checking router: 8ec4de9e-dbf9-4aec-bff5-67be839601cd for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:02:52.799338 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Updating router 8ec4de9e-dbf9-4aec-bff5-67be839601cd port e9bba504-b226-44cb-b431-8dd5e4840c85 binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 15:02:52.820349 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1231a13c-e84b-5bcd-82ca-f31ff53a6b49-9d4ba502-25f4-4402-adc5-0da53ae8c6f3', 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'fixed_ips': [{'subnet_id': 'fa62aa41-73bf-425b-8c66-b411b9d45c33'}]}} from dv-cinder-776422-5-iscsi. {{(pid=101619) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 12 15:02:52.821215 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.853751 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.906509 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0bc84d78-3052-42c6-b327-391df34810fb up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:52.916419 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:52.936156 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.085080 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Allocated IP 172.27.3.42 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/34a8473e-adc9-4eb2-9c6e-71fa68f754de) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:02:53.091923 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.db_base_plugin_common [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Allocated IP 172.20.0.2 (9d4ba502-25f4-4402-adc5-0da53ae8c6f3/fa62aa41-73bf-425b-8c66-b411b9d45c33/de16a396-d483-4270-a3d0-701ff978fa77) {{(pid=101619) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:02:53.107840 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d09f2ea8-6983-4c72-b99c-5af917a8150b req-835da6d7-ce14-4f1e-bb8f-a83e2d319fd9 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:53.110213 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d09f2ea8-6983-4c72-b99c-5af917a8150b req-835da6d7-ce14-4f1e-bb8f-a83e2d319fd9 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 946 time: 0.0893278 Nov 12 15:02:53.117952 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 0bc84d78-3052-42c6-b327-391df34810fb triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:53.118323 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.231522 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d09f2ea8-6983-4c72-b99c-5af917a8150b req-16da1322-1e93-497b-9ec5-ccc0d81060f4 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1143668 Nov 12 15:02:53.263552 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.305335 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.347758 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:53.350628 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:53.356499 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:02:53.382390 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Pushing event updated for resources: {'Port': ['ID=34a8473e-adc9-4eb2-9c6e-71fa68f754de,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:53.414573 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Publish callbacks [] for port, precommit_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.445163 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108'] for port, after_create {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.494261 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.508545 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 is already hosted by enough agents. {{(pid=101619) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:53.509362 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.516363 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.scheduler.base_scheduler [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Resources bound (agent type, host, resource id): {{(pid=101619) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:53.522209 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Received port after_create {{(pid=101619) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:02:53.524483 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Pushing event updated for resources: {'Port': ['ID=de16a396-d483-4270-a3d0-701ff978fa77,revision_number=1']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:53.634071 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55810c8d-a555-4d3c-a9c5-cea7659da815 None None] Pushing event updated for resources: {'Port': ['ID=e9bba504-b226-44cb-b431-8dd5e4840c85,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:53.663053 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Attempting to bind port de16a396-d483-4270-a3d0-701ff978fa77 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:02:53.663421 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Attempting to bind port de16a396-d483-4270-a3d0-701ff978fa77 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': 'b73d2421-3f63-48d8-9968-cd0326575a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:02:53.663781 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Attempting to bind port de16a396-d483-4270-a3d0-701ff978fa77 on network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:53.676594 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Attempting to bind port e9bba504-b226-44cb-b431-8dd5e4840c85 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:02:53.676966 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Attempting to bind port e9bba504-b226-44cb-b431-8dd5e4840c85 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:02:53.677329 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Attempting to bind port e9bba504-b226-44cb-b431-8dd5e4840c85 on network 370662ef-db75-4207-9a43-c725449d1d6d {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:53.679800 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 2, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:02:53.679978 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Checking segment: {'id': 'b73d2421-3f63-48d8-9968-cd0326575a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:53.680323 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.680719 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Bound using segment: {'id': 'b73d2421-3f63-48d8-9968-cd0326575a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:02:53.681194 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Bound port: de16a396-d483-4270-a3d0-701ff978fa77, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b73d2421-3f63-48d8-9968-cd0326575a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:02:53.681572 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.703414 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 2, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:02:53.704350 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Checking segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:53.704350 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.704584 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Bound using segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:02:53.705071 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Bound port: e9bba504-b226-44cb-b431-8dd5e4840c85, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:02:53.705461 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.716940 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.829432 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] For port de16a396-d483-4270-a3d0-701ff978fa77, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:02:53.834184 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] For port de16a396-d483-4270-a3d0-701ff978fa77, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=de16a396-d483-4270-a3d0-701ff978fa77,segment=NetworkSegment(b73d2421-3f63-48d8-9968-cd0326575a2e),segment_id=b73d2421-3f63-48d8-9968-cd0326575a2e)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:02:53.835196 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-c365163c-c0c5-49b3-86b3-40f1bff114e9 None None] Provisioning complete for port e9bba504-b226-44cb-b431-8dd5e4840c85 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:53.835630 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c365163c-c0c5-49b3-86b3-40f1bff114e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.840597 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] For port e9bba504-b226-44cb-b431-8dd5e4840c85, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:02:53.843100 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.899996 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] For port e9bba504-b226-44cb-b431-8dd5e4840c85, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=e9bba504-b226-44cb-b431-8dd5e4840c85,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:02:53.913536 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.931257 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-c365163c-c0c5-49b3-86b3-40f1bff114e9 None None] Port e9bba504-b226-44cb-b431-8dd5e4840c85 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:02:53.956438 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cbc9d8f-0402-4829-9bd7-436de9fc696a None None] Pushing event updated for resources: {'Port': ['ID=de16a396-d483-4270-a3d0-701ff978fa77,revision_number=2']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:53.961502 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1755191', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1760177'] for router, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:53.988223 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:53.988925 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:54.095196 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55810c8d-a555-4d3c-a9c5-cea7659da815 None None] Pushing event updated for resources: {'Port': ['ID=e9bba504-b226-44cb-b431-8dd5e4840c85,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:54.125418 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Router b6036e8a-2583-46eb-9961-76d9c6b2793c is scheduled to L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 with binding_index 1 {{(pid=101618) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 12 15:02:54.140559 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:54.289316 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:02:54.302456 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Sync routers for ids ['b6036e8a-2583-46eb-9961-76d9c6b2793c'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:02:54.315625 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Routers {'b6036e8a-2583-46eb-9961-76d9c6b2793c'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:54.316723 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['b6036e8a-2583-46eb-9961-76d9c6b2793c'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:54.320538 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:54.324500 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-cda9bcf4-854f-44fa-980e-131900180640 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.8430367 Nov 12 15:02:54.325182 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33648) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:54.392693 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afdde8d8-0a29-497f-b070-db7ce361ebdd req-014bd8df-2e86-4818-9b9a-cbfb7c387b86 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:54.394392 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-afdde8d8-0a29-497f-b070-db7ce361ebdd req-014bd8df-2e86-4818-9b9a-cbfb7c387b86 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 946 time: 0.0747328 Nov 12 15:02:54.413091 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-12c51295-a499-4c9a-9dd9-11f5f3d02cad None None] Provisioning complete for port e9bba504-b226-44cb-b431-8dd5e4840c85 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:54.413630 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-12c51295-a499-4c9a-9dd9-11f5f3d02cad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:54.451351 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Set router b6036e8a-2583-46eb-9961-76d9c6b2793c gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:54.474180 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-afdde8d8-0a29-497f-b070-db7ce361ebdd req-ea880636-059b-4d57-a6b7-79abb12f02d6 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671151 Nov 12 15:02:54.500157 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-f6d1018f-0198-433e-8015-681a862a112f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:53Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:54.677356 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42'}], 'enable_snat': True}, 'gw_port_id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:53Z', 'revision_number': 3, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'gw_port': {'id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:03:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 575, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:53Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:54.707534 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Checking router: b6036e8a-2583-46eb-9961-76d9c6b2793c for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:02:54.708025 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Updating router b6036e8a-2583-46eb-9961-76d9c6b2793c port 34a8473e-adc9-4eb2-9c6e-71fa68f754de binding host dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 15:02:54.736388 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:54.756649 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-12c51295-a499-4c9a-9dd9-11f5f3d02cad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:54.776871 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6d1018f-0198-433e-8015-681a862a112f None None] The sync data for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi is: [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:53Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:02:54.835619 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-12c51295-a499-4c9a-9dd9-11f5f3d02cad None None] For port e9bba504-b226-44cb-b431-8dd5e4840c85, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=e9bba504-b226-44cb-b431-8dd5e4840c85,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:54.873400 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d01ad832-d4ec-43d2-81fe-2baa8c1e80e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:54.881926 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-12c51295-a499-4c9a-9dd9-11f5f3d02cad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.004615 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12c51295-a499-4c9a-9dd9-11f5f3d02cad None None] Pushing event updated for resources: {'Port': ['ID=e9bba504-b226-44cb-b431-8dd5e4840c85,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:55.158503 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device de16a396-d483-4270-a3d0-701ff978fa77 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:55.233907 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port de16a396-d483-4270-a3d0-701ff978fa77 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:55.234566 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.270693 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Publish callbacks [] for port, precommit_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.281200 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.324155 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30de68d0-4bac-43f5-a596-1a02a2135808 None None] Pushing event updated for resources: {'Port': ['ID=34a8473e-adc9-4eb2-9c6e-71fa68f754de,revision_number=2']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:55.345954 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Attempting to bind port 34a8473e-adc9-4eb2-9c6e-71fa68f754de on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:02:55.346898 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Attempting to bind port 34a8473e-adc9-4eb2-9c6e-71fa68f754de by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:02:55.346898 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Attempting to bind port 34a8473e-adc9-4eb2-9c6e-71fa68f754de on network bc8f81a5-42b5-4692-9e4b-bc049497e795 {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:55.352248 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 2, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:02:55.352621 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Checking segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101620) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:55.353017 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.353400 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Bound using segment: {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'} {{(pid=101620) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:02:55.353875 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.managers [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Bound port: 34a8473e-adc9-4eb2-9c6e-71fa68f754de, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7c3cb67f-9891-4250-9faf-30a0a52f7e95', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795'}}] {{(pid=101620) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:02:55.354233 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.372377 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.407732 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] For port 34a8473e-adc9-4eb2-9c6e-71fa68f754de, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101620) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:02:55.412276 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.plugins.ml2.db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] For port 34a8473e-adc9-4eb2-9c6e-71fa68f754de, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=34a8473e-adc9-4eb2-9c6e-71fa68f754de,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101620) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:02:55.419351 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron_lib.callbacks.manager [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101620) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.430524 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port de16a396-d483-4270-a3d0-701ff978fa77, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=de16a396-d483-4270-a3d0-701ff978fa77,segment=NetworkSegment(b73d2421-3f63-48d8-9968-cd0326575a2e),segment_id=b73d2421-3f63-48d8-9968-cd0326575a2e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:55.440189 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.443646 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device e9bba504-b226-44cb-b431-8dd5e4840c85 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:55.454621 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.493042 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30de68d0-4bac-43f5-a596-1a02a2135808 None None] Pushing event updated for resources: {'Port': ['ID=34a8473e-adc9-4eb2-9c6e-71fa68f754de,revision_number=3']} {{(pid=101620) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:55.494359 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-098fa6df-54e2-440b-ba2b-3c343ec6a221 None None] Network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:02:55.506411 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Routers {'b6036e8a-2583-46eb-9961-76d9c6b2793c'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:55.507209 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['b6036e8a-2583-46eb-9961-76d9c6b2793c'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:55.636833 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] Set router b6036e8a-2583-46eb-9961-76d9c6b2793c gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:55.646663 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-52567f39-dfaf-41bc-8f43-462d6b0520a1 None None] Provisioning complete for port de16a396-d483-4270-a3d0-701ff978fa77 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:55.647029 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-52567f39-dfaf-41bc-8f43-462d6b0520a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.648698 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.681477 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=de16a396-d483-4270-a3d0-701ff978fa77,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:55.714689 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.715481 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.715949 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.716313 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.716748 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.717230 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.719656 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.721034 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.721685 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.722260 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.722842 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.724239 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:55.746805 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Allocated IP 172.20.0.1 (9d4ba502-25f4-4402-adc5-0da53ae8c6f3/fa62aa41-73bf-425b-8c66-b411b9d45c33/fbed417a-c776-48bd-9e9c-994fd950d141) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:02:55.761433 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port e9bba504-b226-44cb-b431-8dd5e4840c85 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:55.761683 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.915220 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:55.928963 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42'}], 'enable_snat': True}, 'gw_port_id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:53Z', 'revision_number': 3, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'gw_port': {'id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:03:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 575, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:55.963014 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82ffdec6-ac4b-4f70-9ad5-cc2a21e0e509 None None] The sync data for ids ['b6036e8a-2583-46eb-9961-76d9c6b2793c'] in dv-cinder-776422-5-iscsi is: [{'id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42'}], 'enable_snat': True}, 'gw_port_id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:53Z', 'revision_number': 3, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'gw_port': {'id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:03:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 575, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:55Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:02:55.985051 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:56.041011 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:56.044491 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:56.048213 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:02:56.054691 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Pushing event updated for resources: {'Port': ['ID=fbed417a-c776-48bd-9e9c-994fd950d141,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:56.095900 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1754724'] for router_interface, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:56.251683 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-248c8d01-6105-4830-944d-88db4eba9f48 None None] Provisioning complete for port de16a396-d483-4270-a3d0-701ff978fa77 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:56.252338 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-248c8d01-6105-4830-944d-88db4eba9f48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:56.343888 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:56.581744 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-eed224b0-0e3c-4525-b56e-4fe8fafa3995 None None] Provisioning complete for port fbed417a-c776-48bd-9e9c-994fd950d141 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:56.582119 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-eed224b0-0e3c-4525-b56e-4fe8fafa3995 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:56.622134 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:56.628492 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:56.643817 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-eed224b0-0e3c-4525-b56e-4fe8fafa3995 None None] Port fbed417a-c776-48bd-9e9c-994fd950d141 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:02:56.715294 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1611100', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1754864'] for router_interface, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:56.717779 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Pushing event updated for resources: {'Port': ['ID=fbed417a-c776-48bd-9e9c-994fd950d141,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:56.925936 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:56.929920 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:56.963306 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:57.028379 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-d98b3549-a69f-4196-aaf9-62cbfc8951bb tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:57.029310 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-d98b3549-a69f-4196-aaf9-62cbfc8951bb tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 815 time: 0.2409573 Nov 12 15:02:57.057702 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device de16a396-d483-4270-a3d0-701ff978fa77 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:57.103758 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-55e9c65e-bbac-437a-93da-20591878cf37 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/quotas/4a3b37db0a5944228023e883b9a67692 HTTP/1.1" status: 200 len: 375 time: 0.0642014 Nov 12 15:02:57.146872 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port de16a396-d483-4270-a3d0-701ff978fa77 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:57.147287 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:57.179576 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Router b6036e8a-2583-46eb-9961-76d9c6b2793c has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:02:57.245382 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-0090959e-e14a-4f0e-a9c4-086a394d4c61 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1245372 Nov 12 15:02:57.248036 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 34a8473e-adc9-4eb2-9c6e-71fa68f754de up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:57.300992 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-aa7343f3-69dd-41cb-b9a6-c6bed18b097c None None] Provisioning complete for port fbed417a-c776-48bd-9e9c-994fd950d141 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:57.301663 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-aa7343f3-69dd-41cb-b9a6-c6bed18b097c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:57.341988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-aa7343f3-69dd-41cb-b9a6-c6bed18b097c None None] Port fbed417a-c776-48bd-9e9c-994fd950d141 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:02:57.344956 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 34a8473e-adc9-4eb2-9c6e-71fa68f754de triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:57.345322 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:57.372800 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:02:57.379012 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-56a2b13a-4e2c-42bc-b78a-5d4643ac4d53 admin admin] 10.222.0.61 "PUT /v2.0/routers/b6036e8a-2583-46eb-9961-76d9c6b2793c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0527086 Nov 12 15:02:57.404863 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-be1ab746-fd5c-4dce-90bd-1d16b979fb93 service neutron] 10.222.0.61 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1502635 Nov 12 15:02:57.444680 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:57.466905 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] For port 34a8473e-adc9-4eb2-9c6e-71fa68f754de, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=34a8473e-adc9-4eb2-9c6e-71fa68f754de,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:02:57.473646 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:57.474605 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device e9bba504-b226-44cb-b431-8dd5e4840c85 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:57.511291 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-95270e60-2535-47dc-bac3-c8d069a895bd service neutron] 10.222.0.61 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0987475 Nov 12 15:02:57.563518 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Pushing event updated for resources: {'Port': ['ID=34a8473e-adc9-4eb2-9c6e-71fa68f754de,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:57.577559 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port e9bba504-b226-44cb-b431-8dd5e4840c85 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:57.578132 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:57.720016 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1d3f95e4-044b-45c4-af0f-ac5f8a80aa6b req-3c2e4f25-e676-4bd5-b2d1-11e1ce222d52 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 210 time: 0.0333443 Nov 12 15:02:57.937618 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.115469 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33698) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:58.120649 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-a83a9c9a-7324-4860-9be5-4cbd5d5dd37e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-61519927', 'description': 'tempest-secgroup-smoke-61519927 description', 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:58.150442 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a83a9c9a-7324-4860-9be5-4cbd5d5dd37e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.234429 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a83a9c9a-7324-4860-9be5-4cbd5d5dd37e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.239401 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a83a9c9a-7324-4860-9be5-4cbd5d5dd37e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.274164 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a83a9c9a-7324-4860-9be5-4cbd5d5dd37e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.275404 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-a83a9c9a-7324-4860-9be5-4cbd5d5dd37e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1807 time: 0.1587799 Nov 12 15:02:58.277570 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a83a9c9a-7324-4860-9be5-4cbd5d5dd37e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'SecurityGroup': ['ID=df9b544e-58f6-4924-9387-7a81ef202db0,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:58.278559 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33700) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:58.284134 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-82193507-09a3-4291-8877-05dd37e43fc0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'security_group_rule': {'security_group_id': 'df9b544e-58f6-4924-9387-7a81ef202db0', 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:58.318577 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-82193507-09a3-4291-8877-05dd37e43fc0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.362542 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Sync routers for ids ['b6036e8a-2583-46eb-9961-76d9c6b2793c'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:02:58.372606 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Routers {'b6036e8a-2583-46eb-9961-76d9c6b2793c'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:58.373224 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['b6036e8a-2583-46eb-9961-76d9c6b2793c'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:58.394643 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-82193507-09a3-4291-8877-05dd37e43fc0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.400101 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-82193507-09a3-4291-8877-05dd37e43fc0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.433895 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82193507-09a3-4291-8877-05dd37e43fc0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dd31ba89-c169-4117-b70a-a95734baf15a,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:58.441628 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-82193507-09a3-4291-8877-05dd37e43fc0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.445804 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-82193507-09a3-4291-8877-05dd37e43fc0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1636801 Nov 12 15:02:58.446297 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33702) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:58.450766 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-99952a81-0f42-409d-a668-2a204b57245d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'security_group_rule': {'security_group_id': 'df9b544e-58f6-4924-9387-7a81ef202db0', 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:58.498469 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-99952a81-0f42-409d-a668-2a204b57245d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.515625 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Set router b6036e8a-2583-46eb-9961-76d9c6b2793c gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:02:58.563244 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-99952a81-0f42-409d-a668-2a204b57245d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.568009 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-99952a81-0f42-409d-a668-2a204b57245d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.587165 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99952a81-0f42-409d-a668-2a204b57245d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3e1ef5ce-ed06-487c-a69b-23cb4c893e54,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:58.596852 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-99952a81-0f42-409d-a668-2a204b57245d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.598286 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-99952a81-0f42-409d-a668-2a204b57245d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1510715 Nov 12 15:02:58.601033 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33704) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:58.605769 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-43ab93ef-8072-47fc-bd35-c82b8ea774d4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'security_group_rule': {'security_group_id': 'df9b544e-58f6-4924-9387-7a81ef202db0', 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:58.635591 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-43ab93ef-8072-47fc-bd35-c82b8ea774d4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.701181 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-43ab93ef-8072-47fc-bd35-c82b8ea774d4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.705828 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-43ab93ef-8072-47fc-bd35-c82b8ea774d4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.730842 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43ab93ef-8072-47fc-bd35-c82b8ea774d4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5ae0a8e7-841a-4835-b06d-789fc4b4f5ea,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:58.744148 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-43ab93ef-8072-47fc-bd35-c82b8ea774d4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.751478 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33708) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:58.752649 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-43ab93ef-8072-47fc-bd35-c82b8ea774d4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1496685 Nov 12 15:02:58.758381 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-65eadfb5-2416-4a91-86df-80b1a63f2e1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'security_group_rule': {'security_group_id': 'df9b544e-58f6-4924-9387-7a81ef202db0', 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:58.787326 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42'}], 'enable_snat': True}, 'gw_port_id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:56Z', 'revision_number': 4, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'gw_port': {'id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:03:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 575, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'fbed417a-c776-48bd-9e9c-994fd950d141', 'name': '', 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'mac_address': 'fa:16:3e:1e:c6:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_interface', 'standard_attr_id': 576, 'fixed_ips': [{'subnet_id': 'fa62aa41-73bf-425b-8c66-b411b9d45c33', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:55Z', 'updated_at': '2021-11-12T15:02:56Z', 'revision_number': 2, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'subnets': [{'id': 'fa62aa41-73bf-425b-8c66-b411b9d45c33', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:58.818119 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-65eadfb5-2416-4a91-86df-80b1a63f2e1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:58.822597 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Checking router: b6036e8a-2583-46eb-9961-76d9c6b2793c for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:02:58.822950 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Updating router b6036e8a-2583-46eb-9961-76d9c6b2793c port fbed417a-c776-48bd-9e9c-994fd950d141 binding host dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 12 15:02:58.845985 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9d28b266-3a98-4bc0-8ab3-0bfd0ac1a0d0 req-06ab4a0a-691c-4c05-bc33-9ba9b83db1fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 210 time: 0.0390491 Nov 12 15:02:58.861614 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.004577 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-85347660-e826-4baa-b323-040a740986d9 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:59.006004 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-85347660-e826-4baa-b323-040a740986d9 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 815 time: 0.1590672 Nov 12 15:02:59.009525 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 34a8473e-adc9-4eb2-9c6e-71fa68f754de up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:02:59.015488 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-65eadfb5-2416-4a91-86df-80b1a63f2e1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.021643 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Request body: {'port': {'device_id': '23399178-4e26-4d44-9cfe-f494b8281806', 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381', 'admin_state_up': True, 'tenant_id': '4a3b37db0a5944228023e883b9a67692'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:59.026615 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-65eadfb5-2416-4a91-86df-80b1a63f2e1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.093007 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65eadfb5-2416-4a91-86df-80b1a63f2e1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=627cd516-56ae-4ce0-b094-3eaa57b55dba,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:59.104604 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-65eadfb5-2416-4a91-86df-80b1a63f2e1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.108822 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-65eadfb5-2416-4a91-86df-80b1a63f2e1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3518291 Nov 12 15:02:59.109072 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33714) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:59.113526 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-d070bf6c-35e9-418b-bfee-c26a03b8e331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'security_group_rule': {'security_group_id': 'df9b544e-58f6-4924-9387-7a81ef202db0', 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:59.137808 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port 34a8473e-adc9-4eb2-9c6e-71fa68f754de triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:59.138177 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.162068 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.securitygroups_db [None req-d070bf6c-35e9-418b-bfee-c26a03b8e331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Project e0bd63a24fe9453c84dae6d5536c0df9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 12 15:02:59.172978 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d070bf6c-35e9-418b-bfee-c26a03b8e331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.202734 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Made reservation on behalf of 4a3b37db0a5944228023e883b9a67692 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:02:59.206308 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.299505 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d070bf6c-35e9-418b-bfee-c26a03b8e331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.307647 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d070bf6c-35e9-418b-bfee-c26a03b8e331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.335919 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d070bf6c-35e9-418b-bfee-c26a03b8e331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a4fb2307-8310-46ef-bf62-bf07107554ff,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:59.361528 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d070bf6c-35e9-418b-bfee-c26a03b8e331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.362730 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d070bf6c-35e9-418b-bfee-c26a03b8e331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2527812 Nov 12 15:02:59.365401 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33716) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:02:59.371626 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-716b8e3f-3bbf-4cdb-9b09-45dcb1812e6e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'security_group_rule': {'security_group_id': 'df9b544e-58f6-4924-9387-7a81ef202db0', 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:59.412488 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Allocated IP 172.20.0.12 (b3def5d6-542f-430c-929b-c115bf33a381/6c234914-5201-4acb-90e6-43368a9bb837/1eda655d-6ba3-495a-83dc-b145dcdd306b) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:02:59.417024 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Publish callbacks [] for port, precommit_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.421815 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.securitygroups_db [None req-716b8e3f-3bbf-4cdb-9b09-45dcb1812e6e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Project e0bd63a24fe9453c84dae6d5536c0df9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 12 15:02:59.426586 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.429838 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-716b8e3f-3bbf-4cdb-9b09-45dcb1812e6e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.481305 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9127c298-1fd1-40b8-9a64-a2f0b402f6bc None None] Pushing event updated for resources: {'Port': ['ID=fbed417a-c776-48bd-9e9c-994fd950d141,revision_number=3']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:59.541945 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Attempting to bind port fbed417a-c776-48bd-9e9c-994fd950d141 on host dv-cinder-776422-5-iscsi for vnic_type normal with profile {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:02:59.542328 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Attempting to bind port fbed417a-c776-48bd-9e9c-994fd950d141 by drivers openvswitch,hyperv on host dv-cinder-776422-5-iscsi at level 0 using segments [{'id': 'b73d2421-3f63-48d8-9968-cd0326575a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3'}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:02:59.542816 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Attempting to bind port fbed417a-c776-48bd-9e9c-994fd950d141 on network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:02:59.548532 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Checking agent: {'id': '2d300d3a-cdf7-4fec-9408-f2d1fa49dd4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-776422-5-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 46, 58), 'started_at': datetime.datetime(2021, 11, 12, 14, 47, 28), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 2, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-776422-5-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:02:59.548898 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Checking segment: {'id': 'b73d2421-3f63-48d8-9968-cd0326575a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101619) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:02:59.549294 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.549738 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Bound using segment: {'id': 'b73d2421-3f63-48d8-9968-cd0326575a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3'} {{(pid=101619) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:02:59.550147 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.managers [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Bound port: fbed417a-c776-48bd-9e9c-994fd950d141, host: dv-cinder-776422-5-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b73d2421-3f63-48d8-9968-cd0326575a2e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3'}}] {{(pid=101619) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:02:59.550518 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.561004 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-716b8e3f-3bbf-4cdb-9b09-45dcb1812e6e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.566374 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-716b8e3f-3bbf-4cdb-9b09-45dcb1812e6e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803506'] for security_group_rule, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.597064 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716b8e3f-3bbf-4cdb-9b09-45dcb1812e6e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=112e7c17-41f4-4b4e-aa99-b6d9fa23b4e9,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:59.607021 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-716b8e3f-3bbf-4cdb-9b09-45dcb1812e6e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group_rule, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.608310 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-716b8e3f-3bbf-4cdb-9b09-45dcb1812e6e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2419150 Nov 12 15:02:59.640361 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] For port fbed417a-c776-48bd-9e9c-994fd950d141, host dv-cinder-776422-5-iscsi, cleared binding levels {{(pid=101619) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:02:59.643714 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.645634 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] For port fbed417a-c776-48bd-9e9c-994fd950d141, host dv-cinder-776422-5-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=fbed417a-c776-48bd-9e9c-994fd950d141,segment=NetworkSegment(b73d2421-3f63-48d8-9968-cd0326575a2e),segment_id=b73d2421-3f63-48d8-9968-cd0326575a2e)] {{(pid=101619) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:02:59.651452 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.689717 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.709637 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['80209aed-5240-4dda-915c-40b00a2280c7', 'd7aa8b81-78d7-4f77-a972-d37582c3137e'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:02:59.743057 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Pushing event updated for resources: {'Port': ['ID=1eda655d-6ba3-495a-83dc-b145dcdd306b,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:59.754202 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.754924 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.754924 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.755233 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.755871 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.756265 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.756738 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.756928 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.757830 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.757830 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.758071 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.758183 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:02:59.768195 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Network b3def5d6-542f-430c-929b-c115bf33a381 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:02:59.769768 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:02:59.776456 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:02:59.789877 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-ccd09c4d-743c-42f5-bfde-01fe17562ecc None None] Provisioning complete for port fbed417a-c776-48bd-9e9c-994fd950d141 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:02:59.791506 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ccd09c4d-743c-42f5-bfde-01fe17562ecc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.794140 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9127c298-1fd1-40b8-9a64-a2f0b402f6bc None None] Pushing event updated for resources: {'Port': ['ID=fbed417a-c776-48bd-9e9c-994fd950d141,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:02:59.815118 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Routers {'b6036e8a-2583-46eb-9961-76d9c6b2793c'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:02:59.815926 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['b6036e8a-2583-46eb-9961-76d9c6b2793c'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:02:59.837040 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:02:59.838090 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:02:59.858199 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-8a06edf1-a5bd-42dc-9fbf-fcdeaae69e7a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8403900 Nov 12 15:02:59.873339 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Request body: {'port': {'device_id': '23399178-4e26-4d44-9cfe-f494b8281806', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:02:59.943586 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:00.057545 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4964e1-ffbd-44d9-8d29-c48e65859c32 req-434634c0-61cc-4a12-84fd-1f3c2a99e890 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:00.059038 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7e4964e1-ffbd-44d9-8d29-c48e65859c32 req-434634c0-61cc-4a12-84fd-1f3c2a99e890 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 932 time: 0.0856063 Nov 12 15:03:00.087094 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] Set router b6036e8a-2583-46eb-9961-76d9c6b2793c gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:03:00.149451 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7e4964e1-ffbd-44d9-8d29-c48e65859c32 req-c8a70407-5f9e-4e27-ae0f-cb2367f19304 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767589 Nov 12 15:03:00.173044 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ccd09c4d-743c-42f5-bfde-01fe17562ecc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:00.304300 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1eda655d-6ba3-495a-83dc-b145dcdd306b {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:03:00.311862 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:00.323692 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Transition to ACTIVE for port object 1eda655d-6ba3-495a-83dc-b145dcdd306b will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:03:00.328949 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:00.331253 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-ccd09c4d-743c-42f5-bfde-01fe17562ecc None None] For port fbed417a-c776-48bd-9e9c-994fd950d141, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=fbed417a-c776-48bd-9e9c-994fd950d141,segment=NetworkSegment(b73d2421-3f63-48d8-9968-cd0326575a2e),segment_id=b73d2421-3f63-48d8-9968-cd0326575a2e)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:00.346026 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ccd09c4d-743c-42f5-bfde-01fe17562ecc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:00.382925 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Pushing event updated for resources: {'Port': ['ID=1eda655d-6ba3-495a-83dc-b145dcdd306b,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:00.458053 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Attempting to bind port 1eda655d-6ba3-495a-83dc-b145dcdd306b on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:03:00.458383 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Attempting to bind port 1eda655d-6ba3-495a-83dc-b145dcdd306b by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:03:00.458705 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Attempting to bind port 1eda655d-6ba3-495a-83dc-b145dcdd306b on network b3def5d6-542f-430c-929b-c115bf33a381 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:03:00.463302 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Port 1eda655d-6ba3-495a-83dc-b145dcdd306b on network b3def5d6-542f-430c-929b-c115bf33a381 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:03:00.463615 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Attempting to bind port 1eda655d-6ba3-495a-83dc-b145dcdd306b on network b3def5d6-542f-430c-929b-c115bf33a381 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:03:00.468746 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 2, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:03:00.469075 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Checking segment: {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:03:00.469449 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Bound using segment: {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:03:00.469860 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Bound port: 1eda655d-6ba3-495a-83dc-b145dcdd306b, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:03:00.470207 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:00.478588 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd09c4d-743c-42f5-bfde-01fe17562ecc None None] Pushing event updated for resources: {'Port': ['ID=fbed417a-c776-48bd-9e9c-994fd950d141,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:00.538241 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-91e1a279-6fd3-45d6-97a9-91335ada3257 None None] Provisioning complete for port fbed417a-c776-48bd-9e9c-994fd950d141 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:03:00.538611 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-91e1a279-6fd3-45d6-97a9-91335ada3257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:00.542315 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] For port 1eda655d-6ba3-495a-83dc-b145dcdd306b, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:03:00.546290 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] For port 1eda655d-6ba3-495a-83dc-b145dcdd306b, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1eda655d-6ba3-495a-83dc-b145dcdd306b,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:03:00.550770 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:00.593599 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:00.594777 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:00.596572 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] 10.222.0.86 "PUT /v2.0/ports/1eda655d-6ba3-495a-83dc-b145dcdd306b HTTP/1.1" status: 200 len: 1094 time: 0.7289031 Nov 12 15:03:00.597258 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '23399178-4e26-4d44-9cfe-f494b8281806', 'tag': '1eda655d-6ba3-495a-83dc-b145dcdd306b'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:00.600845 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a73477eb-b983-4b86-afb3-820bc6a3121c" -d '{"events": [{"name": "network-changed", "server_uuid": "23399178-4e26-4d44-9cfe-f494b8281806", "tag": "1eda655d-6ba3-495a-83dc-b145dcdd306b"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:00.622353 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42'}], 'enable_snat': True}, 'gw_port_id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:56Z', 'revision_number': 4, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'gw_port': {'id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:03:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 575, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'fbed417a-c776-48bd-9e9c-994fd950d141', 'name': '', 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'mac_address': 'fa:16:3e:1e:c6:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_interface', 'standard_attr_id': 576, 'fixed_ips': [{'subnet_id': 'fa62aa41-73bf-425b-8c66-b411b9d45c33', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:55Z', 'updated_at': '2021-11-12T15:02:59Z', 'revision_number': 4, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'subnets': [{'id': 'fa62aa41-73bf-425b-8c66-b411b9d45c33', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:00.630985 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a10b9c2d-50e0-48df-972d-6d00aed564d6 service neutron] Pushing event updated for resources: {'Port': ['ID=1eda655d-6ba3-495a-83dc-b145dcdd306b,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:00.670108 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1052e731-952e-4b3b-a282-d0fea3422f22 None None] The sync data for ids ['b6036e8a-2583-46eb-9961-76d9c6b2793c'] in dv-cinder-776422-5-iscsi is: [{'id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42'}], 'enable_snat': True}, 'gw_port_id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:56Z', 'revision_number': 4, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'gw_port': {'id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:03:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 575, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'fbed417a-c776-48bd-9e9c-994fd950d141', 'name': '', 'network_id': '9d4ba502-25f4-4402-adc5-0da53ae8c6f3', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'mac_address': 'fa:16:3e:1e:c6:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_interface', 'standard_attr_id': 576, 'fixed_ips': [{'subnet_id': 'fa62aa41-73bf-425b-8c66-b411b9d45c33', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:55Z', 'updated_at': '2021-11-12T15:02:59Z', 'revision_number': 4, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'subnets': [{'id': 'fa62aa41-73bf-425b-8c66-b411b9d45c33', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:03:00.723546 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2244dee2-edce-47a3-aa15-a82c6dfcd62b x-openstack-request-id: req-2244dee2-edce-47a3-aa15-a82c6dfcd62b {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:00.725095 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "23399178-4e26-4d44-9cfe-f494b8281806", "tag": "1eda655d-6ba3-495a-83dc-b145dcdd306b", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:00.725095 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-2244dee2-edce-47a3-aa15-a82c6dfcd62b {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:00.725095 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '23399178-4e26-4d44-9cfe-f494b8281806', 'tag': '1eda655d-6ba3-495a-83dc-b145dcdd306b', 'status': 'completed', 'code': 200} Nov 12 15:03:00.731211 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-87035a87-1aee-47d1-b124-17e360fe9f23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:00.736459 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-87035a87-1aee-47d1-b124-17e360fe9f23 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 1097 time: 0.0791607 Nov 12 15:03:00.793651 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-912feb06-e6cf-4936-bef7-66bd3df0dea5 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=1eda655d-6ba3-495a-83dc-b145dcdd306b HTTP/1.1" status: 200 len: 217 time: 0.0460711 Nov 12 15:03:00.854322 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-c11876a1-b00b-44da-84ec-798f7f061ac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:00.856704 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-c11876a1-b00b-44da-84ec-798f7f061ac3 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=6c234914-5201-4acb-90e6-43368a9bb837 HTTP/1.1" status: 200 len: 855 time: 0.0519521 Nov 12 15:03:00.908842 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-4ec78391-09af-4937-93eb-2255772d35d8 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b3def5d6-542f-430c-929b-c115bf33a381&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0353529 Nov 12 15:03:00.943081 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device fbed417a-c776-48bd-9e9c-994fd950d141 up at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:03:00.994512 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Provisioning complete for port fbed417a-c776-48bd-9e9c-994fd950d141 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:03:00.995328 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:01.022515 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-be9d660d-7ffc-434b-912d-cadfeeb8a22a service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1003456 Nov 12 15:03:01.187110 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7548768e-0ff7-4b91-b8f3-f75f711cdadd req-3d2b5fcb-d940-4dda-af3d-1870230fb46a service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1531522 Nov 12 15:03:01.332538 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f366b6a-7deb-4b35-9a9a-018d4554d5b0 req-d92d146a-d338-42f6-910d-1ce56a5a5d1d tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:01.340700 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2f366b6a-7deb-4b35-9a9a-018d4554d5b0 req-d92d146a-d338-42f6-910d-1ce56a5a5d1d tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 944 time: 0.0970480 Nov 12 15:03:01.362002 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-69758528-4319-4a62-a6aa-5ebc68678e0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:01.364453 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-69758528-4319-4a62-a6aa-5ebc68678e0a service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 1097 time: 0.0814292 Nov 12 15:03:01.398529 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2f366b6a-7deb-4b35-9a9a-018d4554d5b0 req-30f8e186-89fc-49bc-8a73-6f7af58029c0 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568848 Nov 12 15:03:01.476353 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-c3890b80-463d-4166-8e0f-28aaaf44063e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:01.477833 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-c3890b80-463d-4166-8e0f-28aaaf44063e service neutron] 10.222.0.86 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 916 time: 0.0954299 Nov 12 15:03:01.531750 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-42b10f0e-6cdb-4270-9f92-fd586d087a45 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=1eda655d-6ba3-495a-83dc-b145dcdd306b HTTP/1.1" status: 200 len: 217 time: 0.0395155 Nov 12 15:03:01.621798 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-bc4f337b-e2f6-419d-9fef-7ddb067fc90c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:01.623170 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-bc4f337b-e2f6-419d-9fef-7ddb067fc90c service neutron] 10.222.0.86 "GET /v2.0/subnets?id=6c234914-5201-4acb-90e6-43368a9bb837 HTTP/1.1" status: 200 len: 855 time: 0.0771096 Nov 12 15:03:01.666676 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-f059d37f-2c50-4e52-92d3-db38cd436ada service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b3def5d6-542f-430c-929b-c115bf33a381&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0329814 Nov 12 15:03:01.771247 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-f5b33cbe-6808-4f68-af7f-b5dbafaf2aee service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0910830 Nov 12 15:03:01.893409 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a73477eb-b983-4b86-afb3-820bc6a3121c req-53b677dd-51c8-40d6-b641-c77e25f458c0 service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1117015 Nov 12 15:03:02.517914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2d2ac65-44c4-4196-a0f2-47cf7c681a6e req-4d8f8ac4-dab3-4130-a8c4-e50640ba4d8e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:02.519943 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d2d2ac65-44c4-4196-a0f2-47cf7c681a6e req-4d8f8ac4-dab3-4130-a8c4-e50640ba4d8e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 944 time: 0.0546064 Nov 12 15:03:02.578933 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d2d2ac65-44c4-4196-a0f2-47cf7c681a6e req-b62bf2bd-ac33-4898-b96a-7eef6d221e91 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514164 Nov 12 15:03:03.277172 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1eda655d-6ba3-495a-83dc-b145dcdd306b details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:03:03.374866 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 1eda655d-6ba3-495a-83dc-b145dcdd306b, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1eda655d-6ba3-495a-83dc-b145dcdd306b,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:03.388006 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '1eda655d-6ba3-495a-83dc-b145dcdd306b', 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381', 'port_id': '1eda655d-6ba3-495a-83dc-b145dcdd306b', 'mac_address': 'fa:16:3e:7e:09:e5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 625, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6c234914-5201-4acb-90e6-43368a9bb837', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:03:03.435765 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:03.449205 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1eda655d-6ba3-495a-83dc-b145dcdd306b {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:03:03.468925 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 1eda655d-6ba3-495a-83dc-b145dcdd306b, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1eda655d-6ba3-495a-83dc-b145dcdd306b,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:03.473203 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:03.522224 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=1eda655d-6ba3-495a-83dc-b145dcdd306b,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:03.698039 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e2272b-5718-4694-ba43-9069a5a28f0e req-62a3f656-58e2-464e-891a-5639242ff1e0 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:03.699519 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-18e2272b-5718-4694-ba43-9069a5a28f0e req-62a3f656-58e2-464e-891a-5639242ff1e0 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 945 time: 0.0516400 Nov 12 15:03:03.747503 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-18e2272b-5718-4694-ba43-9069a5a28f0e req-08d9be8c-ca04-4851-b9d9-7427250b97ee tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414464 Nov 12 15:03:03.799554 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['1eda655d-6ba3-495a-83dc-b145dcdd306b'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:03:04.865657 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d7d67d-1491-4a46-b420-bb87ef317541 req-b518a428-59ef-4eb9-8907-ef3c61ffc80d tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:04.867189 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f0d7d67d-1491-4a46-b420-bb87ef317541 req-b518a428-59ef-4eb9-8907-ef3c61ffc80d tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 945 time: 0.0500190 Nov 12 15:03:04.924809 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f0d7d67d-1491-4a46-b420-bb87ef317541 req-8536cbdb-8911-47c0-86c1-16b877515921 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516684 Nov 12 15:03:04.983932 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:05.286774 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1eda655d-6ba3-495a-83dc-b145dcdd306b up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:03:05.348805 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 1eda655d-6ba3-495a-83dc-b145dcdd306b completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:03:05.354230 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 1eda655d-6ba3-495a-83dc-b145dcdd306b triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:03:05.354706 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:05.447165 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:05.472616 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '23399178-4e26-4d44-9cfe-f494b8281806', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eda655d-6ba3-495a-83dc-b145dcdd306b'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:05.474966 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c82e526-0a88-40bc-9847-b9c1afdd06b4" -d '{"events": [{"server_uuid": "23399178-4e26-4d44-9cfe-f494b8281806", "name": "network-vif-plugged", "status": "completed", "tag": "1eda655d-6ba3-495a-83dc-b145dcdd306b"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:05.489364 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 1eda655d-6ba3-495a-83dc-b145dcdd306b, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1eda655d-6ba3-495a-83dc-b145dcdd306b,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:05.496528 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:05.525979 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd7d2274-d15c-4359-8470-350adda56f64 x-openstack-request-id: req-cd7d2274-d15c-4359-8470-350adda56f64 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:05.526271 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "23399178-4e26-4d44-9cfe-f494b8281806", "name": "network-vif-plugged", "status": "completed", "tag": "1eda655d-6ba3-495a-83dc-b145dcdd306b", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:05.526502 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-cd7d2274-d15c-4359-8470-350adda56f64 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:05.526895 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '23399178-4e26-4d44-9cfe-f494b8281806', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eda655d-6ba3-495a-83dc-b145dcdd306b', 'code': 200} Nov 12 15:03:05.561997 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=1eda655d-6ba3-495a-83dc-b145dcdd306b,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:05.708966 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449444e3-9856-4225-85d3-85ac7b7e04c3 req-511f98e8-58ec-4eb6-93e7-b392675976a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:05.710457 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-449444e3-9856-4225-85d3-85ac7b7e04c3 req-511f98e8-58ec-4eb6-93e7-b392675976a2 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 1099 time: 0.0411141 Nov 12 15:03:05.765386 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-449444e3-9856-4225-85d3-85ac7b7e04c3 req-2b28221e-0977-4874-8fc9-5b5cebb85659 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425780 Nov 12 15:03:06.041402 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d9ffc7b-3250-42f7-a89d-c57a5359980a req-a5d5925e-86c3-443f-9434-c61cfba65708 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:06.043058 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2d9ffc7b-3250-42f7-a89d-c57a5359980a req-a5d5925e-86c3-443f-9434-c61cfba65708 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 946 time: 0.0502889 Nov 12 15:03:06.093354 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2d9ffc7b-3250-42f7-a89d-c57a5359980a req-7b53130e-0411-4e43-8538-bd2e5fd886b1 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442359 Nov 12 15:03:07.212465 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-674de93d-6cab-4a3a-984e-6e4d792ec100 req-33f39f4a-dabc-4756-ace7-b466e6aba551 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:07.213915 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-674de93d-6cab-4a3a-984e-6e4d792ec100 req-33f39f4a-dabc-4756-ace7-b466e6aba551 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 946 time: 0.0477164 Nov 12 15:03:07.264094 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-674de93d-6cab-4a3a-984e-6e4d792ec100 req-dfe34f00-64b2-434c-aa50-23b1d9248950 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435896 Nov 12 15:03:08.804330 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-30378a33-c957-4ec9-93ba-63d12574c825 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0495069 Nov 12 15:03:08.894740 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-42dd1227-c2b7-475d-9ec2-6789a9092cc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:08.896321 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-42dd1227-c2b7-475d-9ec2-6789a9092cc5 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=296b2e6385f04550a366eb21cf48ea40&device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 1100 time: 0.0444229 Nov 12 15:03:09.016565 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-482f0498-13d7-407b-b15e-2c70ebe61098 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:09.018082 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-482f0498-13d7-407b-b15e-2c70ebe61098 service neutron] 10.222.0.86 "GET /v2.0/networks?id=368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 200 len: 918 time: 0.0982795 Nov 12 15:03:09.377548 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-e0ae926b-621d-4d3a-980f-0b7be71b6a4c service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac HTTP/1.1" status: 200 len: 1001 time: 0.3202028 Nov 12 15:03:09.430326 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-fa99d7c1-1c0f-4dc3-932b-b25e9faa4d19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:09.431773 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-fa99d7c1-1c0f-4dc3-932b-b25e9faa4d19 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 200 len: 856 time: 0.0466709 Nov 12 15:03:09.490490 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-d8a16d66-abff-4348-bce1-506ebdb2e0dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:09.492069 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-d8a16d66-abff-4348-bce1-506ebdb2e0dc service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=368d9cfc-aec2-497f-8e69-e7fae7839a5a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0453396 Nov 12 15:03:09.601129 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-74275419-24b1-4d59-9ecb-f2f8572d0a96 service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862181 Nov 12 15:03:09.701969 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-88219bc9-c8e9-41fe-bbb0-bfee2d999d89 req-fb9a5159-ab7e-443c-8dc7-29ac68c41e2b service neutron] 10.222.0.86 "GET /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856941 Nov 12 15:03:10.382025 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7145677a-381f-4f08-aa42-f6a2daacdd03 req-bae9d42d-4efc-407a-a57e-61c1f7850841 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:10.383497 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7145677a-381f-4f08-aa42-f6a2daacdd03 req-bae9d42d-4efc-407a-a57e-61c1f7850841 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 947 time: 0.0514972 Nov 12 15:03:10.432948 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7145677a-381f-4f08-aa42-f6a2daacdd03 req-f4557c9a-b132-419b-b960-aa46c7be6cfc tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0418913 Nov 12 15:03:11.556048 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-325d9e51-4e57-48b8-8d1b-5601abe76eb1 req-b28210fb-a322-4170-aa07-7f87291e4dfd tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:11.557521 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-325d9e51-4e57-48b8-8d1b-5601abe76eb1 req-b28210fb-a322-4170-aa07-7f87291e4dfd tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 947 time: 0.0493605 Nov 12 15:03:11.606036 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-325d9e51-4e57-48b8-8d1b-5601abe76eb1 req-6bf16c13-2508-44ad-ade9-159a214b2566 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0418863 Nov 12 15:03:12.493576 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-143253c4-b089-44b0-853b-982d9b5389e2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:12.495028 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-143253c4-b089-44b0-853b-982d9b5389e2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 947 time: 0.0499401 Nov 12 15:03:12.596245 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Deleting port b0bd777f-598e-4de7-ab20-79ef7b06cdac {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:12.596961 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:12.692821 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] For port b0bd777f-598e-4de7-ab20-79ef7b06cdac, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=b0bd777f-598e-4de7-ab20-79ef7b06cdac,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:12.693187 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:12.741381 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a14dced-45b7-4989-b87a-600884410d18 req-cb7aec33-6662-4baf-9fcd-1799696c7ade tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:12.743176 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3a14dced-45b7-4989-b87a-600884410d18 req-cb7aec33-6662-4baf-9fcd-1799696c7ade tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 947 time: 0.0537395 Nov 12 15:03:12.791670 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3a14dced-45b7-4989-b87a-600884410d18 req-ea137964-411b-4596-8a2d-0d3b4dc28ab5 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups?id=c2a69211-0102-4e9e-9e2f-4bbab81afda5&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0422678 Nov 12 15:03:12.903526 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:12.904044 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:12.904391 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Floating IP a8d92040-35ec-4248-98ce-6ba98302b214 disassociated. External IP: 172.27.3.70, port: b0bd777f-598e-4de7-ab20-79ef7b06cdac. Nov 12 15:03:12.904737 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Calling delete_port for b0bd777f-598e-4de7-ab20-79ef7b06cdac owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:13.031617 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:13.065755 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event deleted for resources: {'Port': ['ID=b0bd777f-598e-4de7-ab20-79ef7b06cdac,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:13.182068 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Router 2b5b59a1-46c8-4703-94e6-adf835fba661 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:03:13.296267 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:03:13.306676 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] Sync routers for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:03:13.316874 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:03:13.317488 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:13.336972 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] No DVR routers for this DVR port b0bd777f-598e-4de7-ab20-79ef7b06cdac on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:03:13.339669 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:13.343860 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7f546c1b-72a1-4a94-aae7-ee698e70b693 req-71f75e52-e3d2-45a3-a23b-fe378817bc56 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.86 "DELETE /v2.0/ports/b0bd777f-598e-4de7-ab20-79ef7b06cdac HTTP/1.1" status: 204 len: 173 time: 0.8396137 Nov 12 15:03:13.344363 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-deleted', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:13.347335 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2701596-5361-4920-b2d2-e34b09dd2dad" -d '{"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-deleted", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:13.394076 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e31bb171-1664-427e-a3dd-ef9687750c1a x-openstack-request-id: req-e31bb171-1664-427e-a3dd-ef9687750c1a {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:13.394467 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f07dd38a-ec20-4983-b54f-53c5d6cd7642", "name": "network-vif-deleted", "tag": "b0bd777f-598e-4de7-ab20-79ef7b06cdac", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:13.394818 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-e31bb171-1664-427e-a3dd-ef9687750c1a {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:13.395312 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f07dd38a-ec20-4983-b54f-53c5d6cd7642', 'name': 'network-vif-deleted', 'tag': 'b0bd777f-598e-4de7-ab20-79ef7b06cdac', 'status': 'completed', 'code': 200} Nov 12 15:03:13.434271 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:03:13.651936 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:13.679292 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] Checking router: 2b5b59a1-46c8-4703-94e6-adf835fba661 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:03:13.687889 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:03:13.688462 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:13.913148 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:03:13.933198 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-97844d89-33ed-4ea7-beae-168020c69eac req-d6516e0f-ddc8-4de6-bad9-6cee0f484aba tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/ports?device_id=f07dd38a-ec20-4983-b54f-53c5d6cd7642 HTTP/1.1" status: 200 len: 210 time: 0.0271537 Nov 12 15:03:14.175552 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:14.207176 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3f44ae4-835c-4ba8-a7bd-3e7e4d25f6fb None None] The sync data for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi is: [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '0833b1db-55ba-43fd-bd5e-04e8eec98b80', 'name': '', 'network_id': '368d9cfc-aec2-497f-8e69-e7fae7839a5a', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'mac_address': 'fa:16:3e:bf:24:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:23Z', 'updated_at': '2021-11-12T14:56:27Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'subnets': [{'id': 'c422e2f7-99f1-47f1-a8bd-e908500e494f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:03:14.456226 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb4e5b59-84aa-4d24-be5b-469c43b932bd None None] New status for floating IP a8d92040-35ec-4248-98ce-6ba98302b214: DOWN {{(pid=101619) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:03:15.024851 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 33876) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:15.081512 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6e2fe5df-da9d-40c0-aed8-da9583c3c4e2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.104190 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6e2fe5df-da9d-40c0-aed8-da9583c3c4e2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.153327 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6e2fe5df-da9d-40c0-aed8-da9583c3c4e2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.156676 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6e2fe5df-da9d-40c0-aed8-da9583c3c4e2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.157849 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-6e2fe5df-da9d-40c0-aed8-da9583c3c4e2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "DELETE /v2.0/security-groups/c2a69211-0102-4e9e-9e2f-4bbab81afda5 HTTP/1.1" status: 204 len: 168 time: 0.1319976 Nov 12 15:03:15.160890 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33878) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:15.168692 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e2fe5df-da9d-40c0-aed8-da9583c3c4e2 tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2a69211-0102-4e9e-9e2f-4bbab81afda5,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:15.176376 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.api.v2.resource [None req-5912fab5-d662-4766-bed1-c74ec80cf00f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] show failed (client error): The resource could not be found. Nov 12 15:03:15.177758 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-5912fab5-d662-4766-bed1-c74ec80cf00f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "GET /v2.0/security-groups/c2a69211-0102-4e9e-9e2f-4bbab81afda5 HTTP/1.1" status: 404 len: 347 time: 0.0156767 Nov 12 15:03:15.180685 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33880) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:15.303383 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:03:15.309108 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Deleting port e321ef24-f0ee-4d80-9313-d68dd3738ba3 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:15.309442 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.323451 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: b0bd777f-598e-4de7-ab20-79ef7b06cdac {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:03:15.323788 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device b0bd777f-598e-4de7-ab20-79ef7b06cdac not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:03:15.620776 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.621100 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.633127 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Calling delete_port for e321ef24-f0ee-4d80-9313-d68dd3738ba3 owned by network:floatingip {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:15.768702 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.794955 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Pushing event deleted for resources: {'Port': ['ID=e321ef24-f0ee-4d80-9313-d68dd3738ba3,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:15.816815 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.817159 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.817489 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.817818 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.818142 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.818465 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.818787 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.819108 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.819425 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.819742 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.820057 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.820395 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:03:15.865260 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks [] for floatingip, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.867729 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:15.868887 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-129e7cc4-af96-4c6c-bb5a-16924c93373f tempest-AttachVolumeShelveTestJSON-411653036 tempest-AttachVolumeShelveTestJSON-411653036-project] 10.222.0.61 "DELETE /v2.0/floatingips/a8d92040-35ec-4248-98ce-6ba98302b214 HTTP/1.1" status: 204 len: 168 time: 0.6872971 Nov 12 15:03:18.074986 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-d7b329b3-66a3-487b-a126-795a33888db8 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:18.076562 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-d7b329b3-66a3-487b-a126-795a33888db8 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 815 time: 0.1091425 Nov 12 15:03:18.091266 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-ad06b6f6-0fa9-4681-88dd-6e15b4e8db2e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/quotas/4a3b37db0a5944228023e883b9a67692 HTTP/1.1" status: 200 len: 375 time: 0.0090418 Nov 12 15:03:18.146110 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-f138be4a-88d8-4615-b1d3-9f48085c5582 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0493627 Nov 12 15:03:18.243504 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-fbf9504c-8802-4fe6-9af9-bb8c2bd129a5 service neutron] 10.222.0.61 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904171 Nov 12 15:03:18.273387 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33956) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:18.336764 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-73f55d11-a730-4c86-9bf0-177fd2a45d18 service neutron] 10.222.0.61 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866084 Nov 12 15:03:18.508615 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4000da73-9afc-47db-9333-bd99d470e10b req-ea6f9254-a5c9-4382-a857-64f50b3f2a5a tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 210 time: 0.0402541 Nov 12 15:03:18.826443 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1754847'] for router_interface, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:19.127307 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Deleting port 0833b1db-55ba-43fd-bd5e-04e8eec98b80 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:19.127644 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:19.190297 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07638503-8bc7-4d4b-bcc9-a40a4c00b654 req-2a6ba530-b65c-4c95-8c6a-77621f20203b tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:19.191760 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-07638503-8bc7-4d4b-bcc9-a40a4c00b654 req-2a6ba530-b65c-4c95-8c6a-77621f20203b tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.1009626 Nov 12 15:03:19.244423 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] For port 0833b1db-55ba-43fd-bd5e-04e8eec98b80, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=0833b1db-55ba-43fd-bd5e-04e8eec98b80,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:19.246213 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:19.268007 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Calling delete_port for 0833b1db-55ba-43fd-bd5e-04e8eec98b80 owned by network:router_interface {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:19.275329 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-07638503-8bc7-4d4b-bcc9-a40a4c00b654 req-f5820af2-19ce-4994-ac93-fddca9c43d80 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0760028 Nov 12 15:03:19.447744 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:19.476473 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Pushing event deleted for resources: {'Port': ['ID=0833b1db-55ba-43fd-bd5e-04e8eec98b80,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:19.603680 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-64483eec-43ff-4d52-94af-42fadd3ee04a req-61413fdd-19b5-434f-b3e3-657b223af92f tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 210 time: 0.0306916 Nov 12 15:03:19.654592 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611175', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1753199'] for router_interface, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:19.766736 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-8407f5e7-e2d8-4219-96c4-704513d0f304 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:19.768098 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-8407f5e7-e2d8-4219-96c4-704513d0f304 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 815 time: 0.1189489 Nov 12 15:03:19.799636 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Request body: {'port': {'device_id': '1f355e55-39e1-4eb4-a05b-0bb003dddf0d', 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381', 'admin_state_up': True, 'tenant_id': '4a3b37db0a5944228023e883b9a67692'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:03:19.888092 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Router 2b5b59a1-46c8-4703-94e6-adf835fba661 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:03:19.923494 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Made reservation on behalf of 4a3b37db0a5944228023e883b9a67692 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:03:19.927132 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:19.995601 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:03:20.000678 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-a5b02b9c-17d4-4ffb-9cb4-fdc02ec2da85 admin admin] 10.222.0.61 "PUT /v2.0/routers/2b5b59a1-46c8-4703-94e6-adf835fba661/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7262437 Nov 12 15:03:20.003150 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33982) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:20.005943 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] Sync routers for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:03:20.017565 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:03:20.018202 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:20.064261 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Allocated IP 172.20.0.4 (b3def5d6-542f-430c-929b-c115bf33a381/6c234914-5201-4acb-90e6-43368a9bb837/2d86f4d7-5139-4920-a182-48324fe8a515) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:03:20.109327 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks [] for router, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.128314 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:03:20.212573 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.226275 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.265526 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.276926 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Deleting port 838116c9-df39-42cd-af51-5ea055dc1510 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:20.277518 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.283383 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['80209aed-5240-4dda-915c-40b00a2280c7', 'd7aa8b81-78d7-4f77-a972-d37582c3137e', '1eda655d-6ba3-495a-83dc-b145dcdd306b'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:03:20.307365 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Network b3def5d6-542f-430c-929b-c115bf33a381 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:03:20.310371 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:03:20.314090 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:03:20.320700 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41'}], 'enable_snat': True}, 'gw_port_id': '838116c9-df39-42cd-af51-5ea055dc1510', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T15:03:19Z', 'revision_number': 5, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port': {'id': '838116c9-df39-42cd-af51-5ea055dc1510', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:65:ef', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'device_owner': 'network:router_gateway', 'standard_attr_id': 304, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T14:56:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:20.356258 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] Checking router: 2b5b59a1-46c8-4703-94e6-adf835fba661 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:03:20.367136 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] Routers {'2b5b59a1-46c8-4703-94e6-adf835fba661'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:03:20.368286 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:02:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['2b5b59a1-46c8-4703-94e6-adf835fba661'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:20.368850 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:20.369509 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.388041 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Pushing event updated for resources: {'Port': ['ID=2d86f4d7-5139-4920-a182-48324fe8a515,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:20.395679 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-37750ad2-1ff6-4c13-8a97-ce13ffab69fa tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6007490 Nov 12 15:03:20.447337 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] For port 838116c9-df39-42cd-af51-5ea055dc1510, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=838116c9-df39-42cd-af51-5ea055dc1510,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:20.447886 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.459182 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] Set router 2b5b59a1-46c8-4703-94e6-adf835fba661 gateway port host: None {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:03:20.470411 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Request body: {'port': {'device_id': '1f355e55-39e1-4eb4-a05b-0bb003dddf0d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:03:20.475358 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-096b0a19-6d41-452f-b18d-07281d50b102 req-60c09b6a-45f5-4d98-bc5e-eb151b364a8a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:20.477034 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-096b0a19-6d41-452f-b18d-07281d50b102 req-60c09b6a-45f5-4d98-bc5e-eb151b364a8a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0841043 Nov 12 15:03:20.478051 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Calling delete_port for 838116c9-df39-42cd-af51-5ea055dc1510 owned by network:router_gateway {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:20.513851 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T15:03:20Z', 'revision_number': 6, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port_host': None}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:20.525831 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.548596 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d0f004-2618-445b-b5e7-31a7bb393661 None None] The sync data for ids ['2b5b59a1-46c8-4703-94e6-adf835fba661'] in dv-cinder-776422-5-iscsi is: [{'id': '2b5b59a1-46c8-4703-94e6-adf835fba661', 'name': 'tempest-AttachVolumeShelveTestJSON-1468822427-router', 'tenant_id': '296b2e6385f04550a366eb21cf48ea40', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T14:56:21Z', 'updated_at': '2021-11-12T15:03:20Z', 'revision_number': 6, 'project_id': '296b2e6385f04550a366eb21cf48ea40', 'gw_port_host': None}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:03:20.588565 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-096b0a19-6d41-452f-b18d-07281d50b102 req-76823620-5498-47a6-8e0f-97196122d6e5 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0668414 Nov 12 15:03:20.719256 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.749608 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Pushing event deleted for resources: {'Port': ['ID=838116c9-df39-42cd-af51-5ea055dc1510,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:20.805069 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a14c689-b48f-47c3-aee3-295f3c579bb9 req-17f5ef79-a46d-44c9-a46f-015ba1783547 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:20.808595 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a14c689-b48f-47c3-aee3-295f3c579bb9 req-17f5ef79-a46d-44c9-a46f-015ba1783547 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 931 time: 0.1079962 Nov 12 15:03:20.813766 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1760149'] for router_gateway, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.893768 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6a14c689-b48f-47c3-aee3-295f3c579bb9 req-43d6c6a9-f40c-408c-a4b9-57b16eec9f30 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787890 Nov 12 15:03:20.904738 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1755136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-43439'] for router, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.906958 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.937497 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2d86f4d7-5139-4920-a182-48324fe8a515 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:03:20.946566 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:20.962851 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Transition to ACTIVE for port object 2d86f4d7-5139-4920-a182-48324fe8a515 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:03:20.967564 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.055219 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Pushing event updated for resources: {'Port': ['ID=2d86f4d7-5139-4920-a182-48324fe8a515,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:21.082172 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0833b1db-55ba-43fd-bd5e-04e8eec98b80 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:03:21.111674 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 0833b1db-55ba-43fd-bd5e-04e8eec98b80 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:03:21.112013 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0833b1db-55ba-43fd-bd5e-04e8eec98b80 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:03:21.115231 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Attempting to bind port 2d86f4d7-5139-4920-a182-48324fe8a515 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:03:21.115571 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Attempting to bind port 2d86f4d7-5139-4920-a182-48324fe8a515 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:03:21.115896 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Attempting to bind port 2d86f4d7-5139-4920-a182-48324fe8a515 on network b3def5d6-542f-430c-929b-c115bf33a381 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:03:21.120750 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Port 2d86f4d7-5139-4920-a182-48324fe8a515 on network b3def5d6-542f-430c-929b-c115bf33a381 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:03:21.121077 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Attempting to bind port 2d86f4d7-5139-4920-a182-48324fe8a515 on network b3def5d6-542f-430c-929b-c115bf33a381 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:03:21.127069 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 3, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:03:21.127499 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Checking segment: {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:03:21.127987 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Bound using segment: {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:03:21.128443 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Bound port: 2d86f4d7-5139-4920-a182-48324fe8a515, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8468f3e5-d352-48c2-8969-f6c1eb1e52f6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 625, 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:03:21.128800 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.196481 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] For port 2d86f4d7-5139-4920-a182-48324fe8a515, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:03:21.199682 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] For port 2d86f4d7-5139-4920-a182-48324fe8a515, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=2d86f4d7-5139-4920-a182-48324fe8a515,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:03:21.204656 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.240789 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1755257'] for router, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.241166 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:21.241471 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2b5b59a1-46c8-4703-94e6-adf835fba661 {{(pid=101617) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 12 15:03:21.241720 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.243059 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] 10.222.0.86 "PUT /v2.0/ports/2d86f4d7-5139-4920-a182-48324fe8a515 HTTP/1.1" status: 200 len: 1093 time: 0.7776551 Nov 12 15:03:21.243499 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1f355e55-39e1-4eb4-a05b-0bb003dddf0d', 'tag': '2d86f4d7-5139-4920-a182-48324fe8a515'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:21.245777 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] Publish callbacks [] for router, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.246052 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9" -d '{"events": [{"name": "network-changed", "server_uuid": "1f355e55-39e1-4eb4-a05b-0bb003dddf0d", "tag": "2d86f4d7-5139-4920-a182-48324fe8a515"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:21.250403 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-3e6a28e2-4a2b-420d-b8e5-53e4ae8e7e82 admin admin] 10.222.0.61 "DELETE /v2.0/routers/2b5b59a1-46c8-4703-94e6-adf835fba661 HTTP/1.1" status: 204 len: 168 time: 1.2428272 Nov 12 15:03:21.251227 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 33994) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:21.296928 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc441859-49e0-405b-9b51-28ec17ebb02a x-openstack-request-id: req-cc441859-49e0-405b-9b51-28ec17ebb02a {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:21.297218 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1f355e55-39e1-4eb4-a05b-0bb003dddf0d", "tag": "2d86f4d7-5139-4920-a182-48324fe8a515", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:21.297474 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-cc441859-49e0-405b-9b51-28ec17ebb02a {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:21.297876 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1f355e55-39e1-4eb4-a05b-0bb003dddf0d', 'tag': '2d86f4d7-5139-4920-a182-48324fe8a515', 'status': 'completed', 'code': 200} Nov 12 15:03:21.307850 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-7cdbe821-1b00-42f6-ac39-c629da8de6fb admin admin] Deleting subnet c422e2f7-99f1-47f1-a8bd-e908500e494f {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:03:21.310236 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0669adc6-b800-4541-8cc0-06b5e0fd0d1b service neutron] Pushing event updated for resources: {'Port': ['ID=2d86f4d7-5139-4920-a182-48324fe8a515,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:21.313014 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7cdbe821-1b00-42f6-ac39-c629da8de6fb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.337188 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:03:21.354788 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7cdbe821-1b00-42f6-ac39-c629da8de6fb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.365949 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-c1830745-05d6-43d8-abfb-e1f014d05847 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:21.367677 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-c1830745-05d6-43d8-abfb-e1f014d05847 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 1096 time: 0.0477023 Nov 12 15:03:21.445183 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-12786428-4162-466f-be24-c2eb3a31873d service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=2d86f4d7-5139-4920-a182-48324fe8a515 HTTP/1.1" status: 200 len: 217 time: 0.0513253 Nov 12 15:03:21.450464 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7cdbe821-1b00-42f6-ac39-c629da8de6fb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.512548 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-1ef17320-f55c-4538-b925-add8ec03be40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:21.514047 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-1ef17320-f55c-4538-b925-add8ec03be40 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=6c234914-5201-4acb-90e6-43368a9bb837 HTTP/1.1" status: 200 len: 855 time: 0.0571609 Nov 12 15:03:21.515790 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7cdbe821-1b00-42f6-ac39-c629da8de6fb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.541524 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdbe821-1b00-42f6-ac39-c629da8de6fb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c422e2f7-99f1-47f1-a8bd-e908500e494f,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:21.549774 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7cdbe821-1b00-42f6-ac39-c629da8de6fb admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.555559 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-7cdbe821-1b00-42f6-ac39-c629da8de6fb admin admin] 10.222.0.61 "DELETE /v2.0/subnets/c422e2f7-99f1-47f1-a8bd-e908500e494f HTTP/1.1" status: 204 len: 168 time: 0.3015575 Nov 12 15:03:21.555997 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34004) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:21.559962 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56606f92-ed1d-49de-ba75-7ddec95deb47 None None] Network 368d9cfc-aec2-497f-8e69-e7fae7839a5a requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:03:21.569617 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-52067b8c-02b4-42fb-8da9-50c8daf85a8e service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b3def5d6-542f-430c-929b-c115bf33a381&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0414612 Nov 12 15:03:21.597188 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-f81c884c-16e2-4cfb-ac3d-5431f45a6c8f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-61519927&fields=id&tenant_id=e0bd63a24fe9453c84dae6d5536c0df9 HTTP/1.1" status: 200 len: 267 time: 0.0875292 Nov 12 15:03:21.640757 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.743513 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Deleting port 537751a3-3099-489d-b7de-9cadf291dcab {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:21.743855 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.809780 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-fdcb94e2-6a02-41b9-a01e-47b234157893 service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2234504 Nov 12 15:03:21.810777 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e53942fa-696c-47f3-b79b-457a90dac6d1 None None] DHCP port deletion for 368d9cfc-aec2-497f-8e69-e7fae7839a5a request from dv-cinder-776422-5-iscsi {{(pid=101619) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 12 15:03:21.833896 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcbf38a6-0a18-4fb3-8017-d831109bf314 req-ec6a3da9-53a9-4c88-8599-d78f7e47804f tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:21.836167 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-dcbf38a6-0a18-4fb3-8017-d831109bf314 req-ec6a3da9-53a9-4c88-8599-d78f7e47804f tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.1269393 Nov 12 15:03:21.842585 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-6c3a8528-0d03-4352-9d57-65665da1a921 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:21.844529 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-6c3a8528-0d03-4352-9d57-65665da1a921 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 811 time: 0.2373765 Nov 12 15:03:21.845850 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] For port 537751a3-3099-489d-b7de-9cadf291dcab, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=537751a3-3099-489d-b7de-9cadf291dcab,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:21.846271 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.871259 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Calling delete_port for 537751a3-3099-489d-b7de-9cadf291dcab owned by network:dhcp {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:21.871606 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-e53942fa-696c-47f3-b79b-457a90dac6d1 None None] Deleting port 537751a3-3099-489d-b7de-9cadf291dcab {{(pid=101619) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:21.871982 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e53942fa-696c-47f3-b79b-457a90dac6d1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.898664 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-8d9a5e6a-4dfc-4c00-befb-22245bec9de1 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/quotas/e0bd63a24fe9453c84dae6d5536c0df9 HTTP/1.1" status: 200 len: 375 time: 0.0419493 Nov 12 15:03:21.941288 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-e53942fa-696c-47f3-b79b-457a90dac6d1 None None] For port 537751a3-3099-489d-b7de-9cadf291dcab, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=537751a3-3099-489d-b7de-9cadf291dcab,segment=NetworkSegment(d67bfce2-3a19-495f-a2aa-b7d951abcd01),segment_id=d67bfce2-3a19-495f-a2aa-b7d951abcd01)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:21.941615 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-dcbf38a6-0a18-4fb3-8017-d831109bf314 req-c6676855-dd04-409c-89e8-01749f40cc28 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0982242 Nov 12 15:03:21.941761 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e53942fa-696c-47f3-b79b-457a90dac6d1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:21.962756 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-e53942fa-696c-47f3-b79b-457a90dac6d1 None None] Calling delete_port for 537751a3-3099-489d-b7de-9cadf291dcab owned by network:dhcp {{(pid=101619) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:21.965331 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-35d63bb8-4f72-42f7-90fa-6468844c028c req-e7eb5997-1b09-4b4a-92c3-1bda286e8bad service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1437817 Nov 12 15:03:21.991693 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-7a3847b1-8c7c-403f-b7b6-14d21c035e2b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0852396 Nov 12 15:03:21.998980 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.035151 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Pushing event deleted for resources: {'Port': ['ID=537751a3-3099-489d-b7de-9cadf291dcab,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:22.074800 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] No DVR routers for this DVR port 537751a3-3099-489d-b7de-9cadf291dcab on host dv-cinder-776422-5-iscsi {{(pid=101617) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:03:22.139966 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-a40b4a70-576d-46c9-b562-66fd131b2885 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:22.141481 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-a40b4a70-576d-46c9-b562-66fd131b2885 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=4a3b37db0a5944228023e883b9a67692&device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 1096 time: 0.0667472 Nov 12 15:03:22.165871 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-438607b9-6e6c-430f-b791-b684b9e02ecd service neutron] 10.222.0.61 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1517050 Nov 12 15:03:22.174189 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.176973 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-2f35f280-16e3-49c5-9e20-ec46e53ad815 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.203637 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a7d283-d788-4032-a346-30ef0dd558a5 req-86050102-91f3-4e97-a186-a600a3f3d4d0 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:22.205071 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e53942fa-696c-47f3-b79b-457a90dac6d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.205396 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b5a7d283-d788-4032-a346-30ef0dd558a5 req-86050102-91f3-4e97-a186-a600a3f3d4d0 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 943 time: 0.1819665 Nov 12 15:03:22.210014 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['368d9cfc-aec2-497f-8e69-e7fae7839a5a']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:22.226104 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd67bfce2-3a19-495f-a2aa-b7d951abcd01') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:22.226471 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd67bfce2-3a19-495f-a2aa-b7d951abcd01') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:22.227660 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e53942fa-696c-47f3-b79b-457a90dac6d1 None None] Pushing event deleted for resources: {'Port': ['ID=537751a3-3099-489d-b7de-9cadf291dcab,revision_number=None']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:22.237632 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e53942fa-696c-47f3-b79b-457a90dac6d1 None None] No DVR routers for this DVR port 537751a3-3099-489d-b7de-9cadf291dcab on host dv-cinder-776422-5-iscsi {{(pid=101619) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:03:22.252704 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.276851 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.290572 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Releasing vlan 638 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:03:22.290962 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:03:22.292621 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:03:22.311529 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b5a7d283-d788-4032-a346-30ef0dd558a5 req-8819dca0-6ed0-4653-b63e-73087cfcc5ab tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941608 Nov 12 15:03:22.312256 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-d39f5a08-646a-4f20-81ca-7241725b39b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:22.313599 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-d39f5a08-646a-4f20-81ca-7241725b39b7 service neutron] 10.222.0.86 "GET /v2.0/networks?id=b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 200 len: 916 time: 0.1573901 Nov 12 15:03:22.316734 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-74b958dc-16f4-404d-bfdf-61b1b0a3bacd service neutron] 10.222.0.61 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1409473 Nov 12 15:03:22.353690 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.360613 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.366962 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] 10.222.0.61 "DELETE /v2.0/networks/368d9cfc-aec2-497f-8e69-e7fae7839a5a HTTP/1.1" status: 204 len: 168 time: 0.8075106 Nov 12 15:03:22.379232 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-e6f1c360-c905-4c28-840c-16f7a20e9a4f service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=2d86f4d7-5139-4920-a182-48324fe8a515 HTTP/1.1" status: 200 len: 217 time: 0.0421965 Nov 12 15:03:22.380803 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b48678-2166-407f-996c-6f5ccadce37f admin admin] Pushing event deleted for resources: {'Network': ['ID=368d9cfc-aec2-497f-8e69-e7fae7839a5a,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:22.434604 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-ada41666-680a-438c-aa10-e19923d1c903 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:22.436675 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-ada41666-680a-438c-aa10-e19923d1c903 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=6c234914-5201-4acb-90e6-43368a9bb837 HTTP/1.1" status: 200 len: 855 time: 0.0464883 Nov 12 15:03:22.481043 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-2424392c-5026-4fc5-9ea6-27d9ae549276 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b3def5d6-542f-430c-929b-c115bf33a381&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0300310 Nov 12 15:03:22.489523 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34018) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:22.592894 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b6624d47-0646-4270-b4d8-1c83641b9519 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=296b2e6385f04550a366eb21cf48ea40&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0997040 Nov 12 15:03:22.593138 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34022) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:22.628497 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-75d13300-4870-43f0-972c-66ac919a9765 req-ad02a467-3f50-42af-b03c-e87c53c7d38a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 210 time: 0.0265911 Nov 12 15:03:22.654338 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-d7469cc6-73fd-4be7-bc0b-663ef8588871 service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1501236 Nov 12 15:03:22.677545 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f3647486-d283-4a6b-9ccd-383f6c612755 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.746729 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f3647486-d283-4a6b-9ccd-383f6c612755 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:22.928651 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 838116c9-df39-42cd-af51-5ea055dc1510 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:03:22.949830 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 838116c9-df39-42cd-af51-5ea055dc1510 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:03:22.950259 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 838116c9-df39-42cd-af51-5ea055dc1510 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:03:22.950930 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 537751a3-3099-489d-b7de-9cadf291dcab no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:03:22.971960 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 537751a3-3099-489d-b7de-9cadf291dcab {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:03:22.972341 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 537751a3-3099-489d-b7de-9cadf291dcab not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:03:23.106147 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f403f85d-1c19-4bba-bf88-b5d18be6a3c9 req-c9f7b722-1d00-42d6-adc9-26ac9008434d service neutron] 10.222.0.86 "GET /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4410889 Nov 12 15:03:23.121990 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3345f841-cd8d-44b1-a96a-407e22eb80a0 req-b23d2fba-b3a9-4468-befb-c8aedb46d85f tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:23.123455 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3345f841-cd8d-44b1-a96a-407e22eb80a0 req-b23d2fba-b3a9-4468-befb-c8aedb46d85f tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0928719 Nov 12 15:03:23.139328 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f3647486-d283-4a6b-9ccd-383f6c612755 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:23.141841 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f3647486-d283-4a6b-9ccd-383f6c612755 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:23.145444 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f3647486-d283-4a6b-9ccd-383f6c612755 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/87f47fd6-882c-434a-96fe-da710aeafe5f HTTP/1.1" status: 204 len: 168 time: 0.5488846 Nov 12 15:03:23.165246 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3647486-d283-4a6b-9ccd-383f6c612755 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87f47fd6-882c-434a-96fe-da710aeafe5f,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:23.200342 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3345f841-cd8d-44b1-a96a-407e22eb80a0 req-dfd219dd-77af-407f-a09e-ad9d30e965a3 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0709081 Nov 12 15:03:23.433214 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f88248-231f-4d44-82ad-4053dd6cd099 req-4ba5ae29-1a44-4488-ac98-16037642d732 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:23.434770 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d6f88248-231f-4d44-82ad-4053dd6cd099 req-4ba5ae29-1a44-4488-ac98-16037642d732 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 943 time: 0.0555005 Nov 12 15:03:23.482825 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-d6f88248-231f-4d44-82ad-4053dd6cd099 req-83c11d46-0d31-4403-a67a-0dd5a697dff2 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420909 Nov 12 15:03:23.745320 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2971a315-1176-4b06-a3ea-8b0411f01c04 req-fd6eab45-5bd0-4193-8135-4a615031a562 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 210 time: 0.0377412 Nov 12 15:03:23.857310 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-2e48959b-6d41-4491-bd6a-328398a31c46 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:23.858772 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-2e48959b-6d41-4491-bd6a-328398a31c46 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 811 time: 0.1249361 Nov 12 15:03:23.934673 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-0bbd5c42-efb5-4e74-a2f8-4e7671040d63 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e0bd63a24fe9453c84dae6d5536c0df9 HTTP/1.1" status: 200 len: 378 time: 0.0599020 Nov 12 15:03:23.955137 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'port': {'device_id': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'admin_state_up': True, 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'security_groups': ['df9b544e-58f6-4924-9387-7a81ef202db0']}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:03:24.071389 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Made reservation on behalf of e0bd63a24fe9453c84dae6d5536c0df9 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:03:24.074951 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:24.206877 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Allocated IP 172.20.0.8 (370662ef-db75-4207-9a43-c725449d1d6d/40c8c5f2-e714-4a04-9300-6f56d57e5158/3d15c733-cbae-41dd-b648-31abd3f8680c) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:03:24.413670 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd83f159-1f02-475f-b2c5-28cb9cd755d2 req-9ed0ff2e-9795-4db5-b755-4b49ff3013f5 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:24.415156 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bd83f159-1f02-475f-b2c5-28cb9cd755d2 req-9ed0ff2e-9795-4db5-b755-4b49ff3013f5 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0885046 Nov 12 15:03:24.457962 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:24.496010 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bd83f159-1f02-475f-b2c5-28cb9cd755d2 req-7100bb31-5d43-41de-9d3a-b160d26fc31e tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0707417 Nov 12 15:03:24.523433 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:24.554715 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c16ff767-0779-4ef3-be64-f80754bf54d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:24.572807 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Network 370662ef-db75-4207-9a43-c725449d1d6d is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:03:24.575990 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:03:24.580661 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:03:24.584647 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'Port': ['ID=3d15c733-cbae-41dd-b648-31abd3f8680c,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:24.605968 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7618715a-40e1-4bad-a6b4-4816a777c8a0 req-8a642670-7546-4ec3-81a6-b77c9ab487ee tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:24.608631 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7618715a-40e1-4bad-a6b4-4816a777c8a0 req-8a642670-7546-4ec3-81a6-b77c9ab487ee tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 943 time: 0.0530784 Nov 12 15:03:24.634694 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:24.635350 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:24.656551 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a3eb7666-a3af-4a7c-b5e1-a25c9f2fb4a2 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7059655 Nov 12 15:03:24.662190 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7618715a-40e1-4bad-a6b4-4816a777c8a0 req-25fa550d-53a5-49b5-9b48-f0a209cb70c9 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479240 Nov 12 15:03:24.677812 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Request body: {'port': {'device_id': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:03:24.740864 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:24.856169 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-ed60784a-f47f-426a-b1e6-afaf21005a69 None None] Provisioning complete for port 3d15c733-cbae-41dd-b648-31abd3f8680c triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:03:24.856555 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-ed60784a-f47f-426a-b1e6-afaf21005a69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:24.893070 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-ed60784a-f47f-426a-b1e6-afaf21005a69 None None] Port 3d15c733-cbae-41dd-b648-31abd3f8680c cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:03:24.954780 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7993be31-5aca-425f-bf37-038ae5d9c967 req-e059bc93-4061-4268-8b9f-cb1b81fa3313 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:24.956184 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7993be31-5aca-425f-bf37-038ae5d9c967 req-e059bc93-4061-4268-8b9f-cb1b81fa3313 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 931 time: 0.1097467 Nov 12 15:03:25.034616 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-7993be31-5aca-425f-bf37-038ae5d9c967 req-65ece5dc-b974-492c-b5bb-4e038b14bbc0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0711570 Nov 12 15:03:25.090297 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3d15c733-cbae-41dd-b648-31abd3f8680c {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:03:25.098479 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:25.110587 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Transition to ACTIVE for port object 3d15c733-cbae-41dd-b648-31abd3f8680c will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:03:25.114324 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:25.199986 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Pushing event updated for resources: {'Port': ['ID=3d15c733-cbae-41dd-b648-31abd3f8680c,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:25.233693 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Attempting to bind port 3d15c733-cbae-41dd-b648-31abd3f8680c on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:03:25.234358 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Attempting to bind port 3d15c733-cbae-41dd-b648-31abd3f8680c by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:03:25.234358 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Attempting to bind port 3d15c733-cbae-41dd-b648-31abd3f8680c on network 370662ef-db75-4207-9a43-c725449d1d6d {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:03:25.239182 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Port 3d15c733-cbae-41dd-b648-31abd3f8680c on network 370662ef-db75-4207-9a43-c725449d1d6d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:03:25.239506 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Attempting to bind port 3d15c733-cbae-41dd-b648-31abd3f8680c on network 370662ef-db75-4207-9a43-c725449d1d6d {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:03:25.245021 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 3, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:03:25.245357 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Checking segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:03:25.245734 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Bound using segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:03:25.246160 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Bound port: 3d15c733-cbae-41dd-b648-31abd3f8680c, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:03:25.246512 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:25.317150 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] For port 3d15c733-cbae-41dd-b648-31abd3f8680c, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:03:25.320285 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] For port 3d15c733-cbae-41dd-b648-31abd3f8680c, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=3d15c733-cbae-41dd-b648-31abd3f8680c,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:03:25.324504 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:25.330229 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 2d86f4d7-5139-4920-a182-48324fe8a515 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:03:25.358054 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:25.358680 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:25.360077 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] 10.222.0.86 "PUT /v2.0/ports/3d15c733-cbae-41dd-b648-31abd3f8680c HTTP/1.1" status: 200 len: 1093 time: 0.6872454 Nov 12 15:03:25.360529 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'tag': '3d15c733-cbae-41dd-b648-31abd3f8680c'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:25.362796 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-51f23c5c-12b8-43a7-b0e6-1687c86e3803" -d '{"events": [{"name": "network-changed", "server_uuid": "b71ba01f-bab4-486f-a7b2-99909d779c41", "tag": "3d15c733-cbae-41dd-b648-31abd3f8680c"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:25.405358 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b4a033-eb1a-4bdc-abd1-fb5f3b3298a0 service neutron] Pushing event updated for resources: {'Port': ['ID=3d15c733-cbae-41dd-b648-31abd3f8680c,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:25.439010 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5288d6bd-ce84-476d-bf88-60d67505474d x-openstack-request-id: req-5288d6bd-ce84-476d-bf88-60d67505474d {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:25.439010 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b71ba01f-bab4-486f-a7b2-99909d779c41", "tag": "3d15c733-cbae-41dd-b648-31abd3f8680c", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:25.439310 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-5288d6bd-ce84-476d-bf88-60d67505474d {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:25.439666 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'tag': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'status': 'completed', 'code': 200} Nov 12 15:03:25.461534 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 2d86f4d7-5139-4920-a182-48324fe8a515, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=2d86f4d7-5139-4920-a182-48324fe8a515,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:25.473235 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '2d86f4d7-5139-4920-a182-48324fe8a515', 'network_id': 'b3def5d6-542f-430c-929b-c115bf33a381', 'port_id': '2d86f4d7-5139-4920-a182-48324fe8a515', 'mac_address': 'fa:16:3e:44:38:f8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 625, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6c234914-5201-4acb-90e6-43368a9bb837', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:03:25.476555 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-32e01e78-aa1a-4962-b3c9-18bb44f2072f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:25.478218 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-32e01e78-aa1a-4962-b3c9-18bb44f2072f service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 1096 time: 0.0585425 Nov 12 15:03:25.528349 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:25.556237 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-8e276c36-60cc-421c-8b08-48791e5e5c3b service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=3d15c733-cbae-41dd-b648-31abd3f8680c HTTP/1.1" status: 200 len: 217 time: 0.0491555 Nov 12 15:03:25.557323 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2d86f4d7-5139-4920-a182-48324fe8a515 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:03:25.566164 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:25.583800 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 2d86f4d7-5139-4920-a182-48324fe8a515, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=2d86f4d7-5139-4920-a182-48324fe8a515,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:25.589599 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:25.652726 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=2d86f4d7-5139-4920-a182-48324fe8a515,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:25.677483 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abeae15e-0f27-4ffc-b577-bc4791b0fa25 req-c1e53d59-fab4-4314-9aab-296e5d306338 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:25.678934 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-abeae15e-0f27-4ffc-b577-bc4791b0fa25 req-c1e53d59-fab4-4314-9aab-296e5d306338 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0949800 Nov 12 15:03:25.687322 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a507bc8c-ec8b-4296-96e1-e4f9298a6248 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:25.688922 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-a507bc8c-ec8b-4296-96e1-e4f9298a6248 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.1219678 Nov 12 15:03:25.771118 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-abeae15e-0f27-4ffc-b577-bc4791b0fa25 req-935f0df2-5f84-41bc-b1f7-25e84c497bb2 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0809133 Nov 12 15:03:25.782091 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-73f805ab-b092-49d8-acd4-884262ad1a43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:25.783692 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-73f805ab-b092-49d8-acd4-884262ad1a43 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0755589 Nov 12 15:03:25.816895 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed69c228-2069-4484-9fbc-18fa53c1ae08 req-59e89642-c97e-4bc8-a592-46f31a40a39c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:25.818392 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ed69c228-2069-4484-9fbc-18fa53c1ae08 req-59e89642-c97e-4bc8-a592-46f31a40a39c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 944 time: 0.0555511 Nov 12 15:03:25.875214 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ed69c228-2069-4484-9fbc-18fa53c1ae08 req-baf86319-9728-4d65-85fe-1263081d8817 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506604 Nov 12 15:03:25.885096 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-6497e408-76f6-44dc-a3a2-da364eb2c6a9 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885103 Nov 12 15:03:25.973513 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['2d86f4d7-5139-4920-a182-48324fe8a515'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:03:25.988022 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-140756f5-f38e-4051-84ef-5f94d58c82a6 req-165319e1-d8bf-41e2-90ac-d6b6440f9b07 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0942814 Nov 12 15:03:26.090652 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-54d792f4-b5e7-4bb8-a9c3-6abe62451c32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:26.092213 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-54d792f4-b5e7-4bb8-a9c3-6abe62451c32 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 1096 time: 0.0442629 Nov 12 15:03:26.212883 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664604ce-f446-4742-ba2b-0d14d7b5a6d0 req-5d03fc55-97b6-41c2-b634-a92d8ba78eab tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:26.214348 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-664604ce-f446-4742-ba2b-0d14d7b5a6d0 req-5d03fc55-97b6-41c2-b634-a92d8ba78eab tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 943 time: 0.1078305 Nov 12 15:03:26.244608 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-271c6656-b9a5-42a1-babb-7a55e7b1984c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:26.245975 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-271c6656-b9a5-42a1-babb-7a55e7b1984c service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.1407495 Nov 12 15:03:26.303828 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-45b2e5a1-2b8a-4d6e-8795-3a127c69e404 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=3d15c733-cbae-41dd-b648-31abd3f8680c HTTP/1.1" status: 200 len: 217 time: 0.0465119 Nov 12 15:03:26.307984 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-664604ce-f446-4742-ba2b-0d14d7b5a6d0 req-c04aa3af-72ab-48bd-b031-1421d4a3796c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0869353 Nov 12 15:03:26.364843 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-56a8a7d2-8c48-4385-b721-e810c84fb213 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:26.366268 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-56a8a7d2-8c48-4385-b721-e810c84fb213 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0476265 Nov 12 15:03:26.424531 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-c226cac6-f081-441c-8b5e-a62119ef28f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:26.425963 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-c226cac6-f081-441c-8b5e-a62119ef28f8 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0397260 Nov 12 15:03:26.521669 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-6529a273-1563-47aa-b20a-04b327dd232b service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832851 Nov 12 15:03:26.617556 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-51f23c5c-12b8-43a7-b0e6-1687c86e3803 req-27548c5c-5a8b-41bd-80e4-37f52658450e service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866764 Nov 12 15:03:26.901207 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c923c493-a305-4d60-a262-10759faab345 req-bc7518c2-52f7-4b8d-b3f1-bf4c4a05e544 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:26.902760 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c923c493-a305-4d60-a262-10759faab345 req-bc7518c2-52f7-4b8d-b3f1-bf4c4a05e544 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0600123 Nov 12 15:03:26.965191 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:26.968287 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-c923c493-a305-4d60-a262-10759faab345 req-f1873a96-dab1-493b-8d2e-c99f055d8eff tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588219 Nov 12 15:03:27.010065 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9887148-d605-47d5-b8f7-cb637e6cf851 req-14dff3ae-3d30-408a-9f48-a9e058778899 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:27.011927 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b9887148-d605-47d5-b8f7-cb637e6cf851 req-14dff3ae-3d30-408a-9f48-a9e058778899 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 944 time: 0.0549772 Nov 12 15:03:27.040610 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34116) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:27.061651 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b9887148-d605-47d5-b8f7-cb637e6cf851 req-1f2f5db9-e43a-450e-b59f-15be6e2cf8d6 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431263 Nov 12 15:03:27.144479 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3e85ee02-3bc6-48b8-b87a-90c8a8821d0e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.216263 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3e85ee02-3bc6-48b8-b87a-90c8a8821d0e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.221062 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-3e85ee02-3bc6-48b8-b87a-90c8a8821d0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.258882 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-3e85ee02-3bc6-48b8-b87a-90c8a8821d0e admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=af85a94dcb5a406299f59ed072935f73&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2172196 Nov 12 15:03:27.260087 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e85ee02-3bc6-48b8-b87a-90c8a8821d0e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=feb9b1b9-92a0-48d5-bd58-8c6823cc1cdb,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:27.261886 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34120) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:27.309238 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8c59c40e-4a9b-4c97-9950-8e65283118c7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.330039 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8c59c40e-4a9b-4c97-9950-8e65283118c7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.360586 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 2d86f4d7-5139-4920-a182-48324fe8a515 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:03:27.382999 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8c59c40e-4a9b-4c97-9950-8e65283118c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.386634 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8c59c40e-4a9b-4c97-9950-8e65283118c7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.391366 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-8c59c40e-4a9b-4c97-9950-8e65283118c7 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/feb9b1b9-92a0-48d5-bd58-8c6823cc1cdb HTTP/1.1" status: 204 len: 168 time: 0.1282427 Nov 12 15:03:27.401802 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c59c40e-4a9b-4c97-9950-8e65283118c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=feb9b1b9-92a0-48d5-bd58-8c6823cc1cdb,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:27.432141 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 2d86f4d7-5139-4920-a182-48324fe8a515 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:03:27.436735 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 2d86f4d7-5139-4920-a182-48324fe8a515 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:03:27.437104 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.451519 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae65602b-aed3-47e2-bac0-f1796b5f5e7d req-8b24c91a-d907-4dff-9840-b48c26cef215 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:27.453032 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ae65602b-aed3-47e2-bac0-f1796b5f5e7d req-8b24c91a-d907-4dff-9840-b48c26cef215 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 943 time: 0.0628555 Nov 12 15:03:27.506627 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ae65602b-aed3-47e2-bac0-f1796b5f5e7d req-6281d812-085b-46e9-a5a2-9b2c21154ed7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0470643 Nov 12 15:03:27.530818 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.556807 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f355e55-39e1-4eb4-a05b-0bb003dddf0d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d86f4d7-5139-4920-a182-48324fe8a515'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:27.559204 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7034969e-8fa7-460b-ab28-c2d253dd4b10" -d '{"events": [{"server_uuid": "1f355e55-39e1-4eb4-a05b-0bb003dddf0d", "name": "network-vif-plugged", "status": "completed", "tag": "2d86f4d7-5139-4920-a182-48324fe8a515"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:27.572904 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 2d86f4d7-5139-4920-a182-48324fe8a515, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=2d86f4d7-5139-4920-a182-48324fe8a515,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:27.578822 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:27.608143 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bad10aeb-7664-460b-87c2-05ffb1e489f8 x-openstack-request-id: req-bad10aeb-7664-460b-87c2-05ffb1e489f8 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:27.608143 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f355e55-39e1-4eb4-a05b-0bb003dddf0d", "name": "network-vif-plugged", "status": "completed", "tag": "2d86f4d7-5139-4920-a182-48324fe8a515", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:27.608143 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-bad10aeb-7664-460b-87c2-05ffb1e489f8 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:27.608654 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1f355e55-39e1-4eb4-a05b-0bb003dddf0d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2d86f4d7-5139-4920-a182-48324fe8a515', 'code': 200} Nov 12 15:03:27.639838 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=2d86f4d7-5139-4920-a182-48324fe8a515,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:27.819487 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6234fe2-38de-4f11-932f-c09fd5f4e7b8 req-70b6eb4d-a5bb-4d22-9820-195de1ed6fb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:27.822011 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f6234fe2-38de-4f11-932f-c09fd5f4e7b8 req-70b6eb4d-a5bb-4d22-9820-195de1ed6fb7 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 1098 time: 0.0656579 Nov 12 15:03:27.872465 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f6234fe2-38de-4f11-932f-c09fd5f4e7b8 req-1d4b5b3a-3f71-4c49-b2f3-60167426065d service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412843 Nov 12 15:03:27.926626 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:28.096012 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f7166c9-ce3e-4b78-b961-e418ff83a3ad req-cd6aafd1-17da-4243-90f0-e7b2aa33f92b tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:28.097867 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1f7166c9-ce3e-4b78-b961-e418ff83a3ad req-cd6aafd1-17da-4243-90f0-e7b2aa33f92b tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0536458 Nov 12 15:03:28.151975 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1f7166c9-ce3e-4b78-b961-e418ff83a3ad req-f8bba8e9-5912-40f4-a4ed-178ccad60685 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473239 Nov 12 15:03:28.194733 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26815ead-59be-4820-a30e-91a4b1c7e661 req-d67419c4-aa80-4b1d-ad05-abae9face252 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:28.196373 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-26815ead-59be-4820-a30e-91a4b1c7e661 req-d67419c4-aa80-4b1d-ad05-abae9face252 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 945 time: 0.0586438 Nov 12 15:03:28.246613 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-26815ead-59be-4820-a30e-91a4b1c7e661 req-32d5b62f-a192-490f-a138-8c0e7559f1d5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437231 Nov 12 15:03:28.624255 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-460b87f5-e941-4574-a7fe-8b988211f866 req-a3fb23fc-2612-4fe0-a8bf-c720dc32bbad tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:28.625838 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-460b87f5-e941-4574-a7fe-8b988211f866 req-a3fb23fc-2612-4fe0-a8bf-c720dc32bbad tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 943 time: 0.0487363 Nov 12 15:03:28.681452 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-460b87f5-e941-4574-a7fe-8b988211f866 req-1e35678c-5675-43e1-ab0c-498a202ca7a8 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0497675 Nov 12 15:03:29.273758 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052bb44c-d68c-43ac-8799-380f0675ad66 req-901dda5c-9ae8-448a-8fd0-6b9c7c36bf5d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:29.281033 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-052bb44c-d68c-43ac-8799-380f0675ad66 req-901dda5c-9ae8-448a-8fd0-6b9c7c36bf5d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0566745 Nov 12 15:03:29.328149 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-052bb44c-d68c-43ac-8799-380f0675ad66 req-04119885-c2ee-41d4-bcca-59fba804857a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462167 Nov 12 15:03:29.372874 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc1e33e-8423-4965-a3ff-2041ec215ad4 req-9aca42f6-bb34-4147-83de-4d93f41364fe tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:29.374348 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bc1e33e-8423-4965-a3ff-2041ec215ad4 req-9aca42f6-bb34-4147-83de-4d93f41364fe tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 945 time: 0.0505745 Nov 12 15:03:29.423411 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bc1e33e-8423-4965-a3ff-2041ec215ad4 req-2b8ec540-36e1-422a-a742-97e1bddb7a76 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424244 Nov 12 15:03:29.800972 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed9f591-ab53-4e3b-ac88-7dac35f88097 req-7853e75e-57c5-430c-b2cf-4ecca8c5f28b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:29.802462 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3ed9f591-ab53-4e3b-ac88-7dac35f88097 req-7853e75e-57c5-430c-b2cf-4ecca8c5f28b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 943 time: 0.0526614 Nov 12 15:03:29.851258 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3ed9f591-ab53-4e3b-ac88-7dac35f88097 req-1163d4fd-fbbb-4b5f-863e-d1a698c37f40 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428443 Nov 12 15:03:30.449169 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546f9e39-1d6f-488d-a440-0b8b091e8a2f req-3105a6fc-72aa-418c-8c02-24dc4054b99f tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:30.450599 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-546f9e39-1d6f-488d-a440-0b8b091e8a2f req-3105a6fc-72aa-418c-8c02-24dc4054b99f tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0505493 Nov 12 15:03:30.505843 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-546f9e39-1d6f-488d-a440-0b8b091e8a2f req-d0e1cd50-387f-41a9-a749-a1800ebc79f1 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454957 Nov 12 15:03:30.973831 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f0d823-207b-4d54-bf23-0f40920c9ee3 req-679ec2e8-1ccb-466d-8e6c-921dbf1d405e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:30.975355 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-03f0d823-207b-4d54-bf23-0f40920c9ee3 req-679ec2e8-1ccb-466d-8e6c-921dbf1d405e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 943 time: 0.0544534 Nov 12 15:03:31.029160 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-03f0d823-207b-4d54-bf23-0f40920c9ee3 req-230b2225-126e-4076-b705-e7c2a3894f6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0468240 Nov 12 15:03:31.627402 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e3b08bd-3a35-4473-abfe-a6ff5d4a9eb6 req-57c185b5-b106-4a23-a0a8-ba9b6565e72d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:31.629398 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6e3b08bd-3a35-4473-abfe-a6ff5d4a9eb6 req-57c185b5-b106-4a23-a0a8-ba9b6565e72d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0547383 Nov 12 15:03:31.679865 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6e3b08bd-3a35-4473-abfe-a6ff5d4a9eb6 req-0fa913df-db7a-4d3c-9699-2c9301543617 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448961 Nov 12 15:03:32.144075 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8597dc8c-0dc0-4922-accb-ca363a868487 req-3025acd7-3d07-486f-a020-268c215b740c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:32.145570 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8597dc8c-0dc0-4922-accb-ca363a868487 req-3025acd7-3d07-486f-a020-268c215b740c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 943 time: 0.0503082 Nov 12 15:03:32.194462 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8597dc8c-0dc0-4922-accb-ca363a868487 req-697aec6d-68ca-43af-b01a-e54e1a51a003 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0428920 Nov 12 15:03:32.797685 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0434c5-ace4-4e7c-a026-8c589b1c28a1 req-f7e7c9b1-229b-4051-afe9-c9896082111d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:32.799147 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2c0434c5-ace4-4e7c-a026-8c589b1c28a1 req-f7e7c9b1-229b-4051-afe9-c9896082111d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0514643 Nov 12 15:03:32.865564 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-2c0434c5-ace4-4e7c-a026-8c589b1c28a1 req-a8c4ec94-7fa7-4ebf-a70a-fd6509b2eaa4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0595026 Nov 12 15:03:33.153948 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34250) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:33.258849 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1807fe84-3525-4fb8-b262-314c220f716e admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.318409 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb23088b-d397-4448-b429-6cf0f1a1bc11 req-875d4b7d-0c92-4e90-852a-a515d39aeb34 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:33.319935 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-eb23088b-d397-4448-b429-6cf0f1a1bc11 req-875d4b7d-0c92-4e90-852a-a515d39aeb34 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 943 time: 0.0544138 Nov 12 15:03:33.333869 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1807fe84-3525-4fb8-b262-314c220f716e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.337846 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-1807fe84-3525-4fb8-b262-314c220f716e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.369553 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-eb23088b-d397-4448-b429-6cf0f1a1bc11 req-e639a9b8-10c8-4784-98e0-9840b78d2976 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0433455 Nov 12 15:03:33.376762 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-1807fe84-3525-4fb8-b262-314c220f716e admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a890dd5b8b0d4973b9107085aee56275&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2217290 Nov 12 15:03:33.377958 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1807fe84-3525-4fb8-b262-314c220f716e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3388e5ae-5635-4517-bc78-697ea222d30c,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:33.379422 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34256) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:33.389271 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 3d15c733-cbae-41dd-b648-31abd3f8680c details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:03:33.436712 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a4d8fc9b-c488-42f2-9bd3-0f28feef011f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.457941 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a4d8fc9b-c488-42f2-9bd3-0f28feef011f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.488611 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 3d15c733-cbae-41dd-b648-31abd3f8680c, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=3d15c733-cbae-41dd-b648-31abd3f8680c,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:33.500780 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'port_id': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'mac_address': 'fa:16:3e:e9:80:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 605, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:03:33.505699 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a4d8fc9b-c488-42f2-9bd3-0f28feef011f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.508335 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a4d8fc9b-c488-42f2-9bd3-0f28feef011f admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.509703 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-a4d8fc9b-c488-42f2-9bd3-0f28feef011f admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/3388e5ae-5635-4517-bc78-697ea222d30c HTTP/1.1" status: 204 len: 168 time: 0.1291122 Nov 12 15:03:33.519600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4d8fc9b-c488-42f2-9bd3-0f28feef011f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3388e5ae-5635-4517-bc78-697ea222d30c,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:33.548526 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.561555 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3d15c733-cbae-41dd-b648-31abd3f8680c {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:03:33.582258 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 3d15c733-cbae-41dd-b648-31abd3f8680c, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=3d15c733-cbae-41dd-b648-31abd3f8680c,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:33.586508 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.635909 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=3d15c733-cbae-41dd-b648-31abd3f8680c,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:33.779815 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34262) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:33.792704 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95959290-1b80-4340-a440-9a817f5eac3c admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.865054 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95959290-1b80-4340-a440-9a817f5eac3c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.868774 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-95959290-1b80-4340-a440-9a817f5eac3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:33.910060 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-95959290-1b80-4340-a440-9a817f5eac3c admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=0e11bfe489154d3385a9a1d829f50cfe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1291413 Nov 12 15:03:33.910884 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95959290-1b80-4340-a440-9a817f5eac3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f9417fa-5d83-417d-b0bc-b24558d4d516,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:33.913209 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34266) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:33.921272 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['3d15c733-cbae-41dd-b648-31abd3f8680c'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:03:34.003812 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-df189294-442e-4cd5-a0ec-f3eb9fe298dd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:34.016069 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47562540-1810-4a45-bca3-608b63dfeee0 req-27446d67-279c-48a8-badc-289625c0a83a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:34.017584 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-47562540-1810-4a45-bca3-608b63dfeee0 req-27446d67-279c-48a8-badc-289625c0a83a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0782764 Nov 12 15:03:34.052692 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-df189294-442e-4cd5-a0ec-f3eb9fe298dd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:34.104783 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-47562540-1810-4a45-bca3-608b63dfeee0 req-8caf1389-9cef-4578-af0a-277d04616b85 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0800533 Nov 12 15:03:34.125400 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-df189294-442e-4cd5-a0ec-f3eb9fe298dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:34.128819 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-df189294-442e-4cd5-a0ec-f3eb9fe298dd admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:34.130039 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-df189294-442e-4cd5-a0ec-f3eb9fe298dd admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/5f9417fa-5d83-417d-b0bc-b24558d4d516 HTTP/1.1" status: 204 len: 168 time: 0.2158484 Nov 12 15:03:34.138830 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df189294-442e-4cd5-a0ec-f3eb9fe298dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f9417fa-5d83-417d-b0bc-b24558d4d516,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:34.387991 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-45280088-2076-4605-95fb-e8a666a9df4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:34.390070 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-45280088-2076-4605-95fb-e8a666a9df4e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=49070bd2a8b542b3801c73a224b4bba5&device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1098 time: 0.0426435 Nov 12 15:03:34.526041 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0183a6b-7e84-4399-bfd8-2f991c107ebf req-dd286a15-b1b5-49ed-8055-afe2d5dd83fe tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:34.527519 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a0183a6b-7e84-4399-bfd8-2f991c107ebf req-dd286a15-b1b5-49ed-8055-afe2d5dd83fe tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 944 time: 0.0751653 Nov 12 15:03:34.529091 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-21e7e75f-9a7f-4b02-aa5f-53c183f1c82c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:34.530393 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-21e7e75f-9a7f-4b02-aa5f-53c183f1c82c service neutron] 10.222.0.86 "GET /v2.0/networks?id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b HTTP/1.1" status: 200 len: 910 time: 0.1315796 Nov 12 15:03:34.626898 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a0183a6b-7e84-4399-bfd8-2f991c107ebf req-447ca796-641e-440c-aa68-254db0a8016f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0928209 Nov 12 15:03:34.628700 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-33253b71-5633-4627-b61b-0520026ce6b2 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ce38b191-8562-4891-b8f8-a8b58d423729 HTTP/1.1" status: 200 len: 1001 time: 0.0887790 Nov 12 15:03:34.685173 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-ed98afcb-332c-4b6d-ac13-1b4d8031ec12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:34.686629 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-ed98afcb-332c-4b6d-ac13-1b4d8031ec12 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=0d076ecb-e243-4855-ace2-0ad087866ab5 HTTP/1.1" status: 200 len: 848 time: 0.0502315 Nov 12 15:03:34.740420 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-0c139358-2a4b-405a-b764-1cf403d54745 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:34.741884 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-0c139358-2a4b-405a-b764-1cf403d54745 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0421743 Nov 12 15:03:34.841800 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-c9f9e6e6-f358-443d-8164-1b5f3e1259de service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0912318 Nov 12 15:03:34.941265 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d39c107-67ce-4723-bf66-c55300eaf3b3 req-886e3b89-0617-4205-80c3-653e533c9375 service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904596 Nov 12 15:03:34.984855 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:35.223824 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41052de3-b52e-404e-8ab3-c17a571a5f46 req-3c6d6a59-ae61-4084-968f-09d197f45b5c tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:35.225376 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-41052de3-b52e-404e-8ab3-c17a571a5f46 req-3c6d6a59-ae61-4084-968f-09d197f45b5c tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0510380 Nov 12 15:03:35.277198 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-41052de3-b52e-404e-8ab3-c17a571a5f46 req-b28ed581-120c-49e0-8f9d-5eb08d6f7062 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448294 Nov 12 15:03:35.407053 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 3d15c733-cbae-41dd-b648-31abd3f8680c up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:03:35.456075 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 3d15c733-cbae-41dd-b648-31abd3f8680c completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:03:35.459960 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 3d15c733-cbae-41dd-b648-31abd3f8680c triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:03:35.460354 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:35.540913 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:35.564632 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3d15c733-cbae-41dd-b648-31abd3f8680c'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:35.566881 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-420f6b88-3a65-4910-86d9-08a90bf1659d" -d '{"events": [{"server_uuid": "b71ba01f-bab4-486f-a7b2-99909d779c41", "name": "network-vif-plugged", "status": "completed", "tag": "3d15c733-cbae-41dd-b648-31abd3f8680c"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:35.580002 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 3d15c733-cbae-41dd-b648-31abd3f8680c, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=3d15c733-cbae-41dd-b648-31abd3f8680c,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:35.586130 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:35.612315 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e47b428-93a2-4a46-9fac-ba13c002027e x-openstack-request-id: req-8e47b428-93a2-4a46-9fac-ba13c002027e {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:35.612606 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b71ba01f-bab4-486f-a7b2-99909d779c41", "name": "network-vif-plugged", "status": "completed", "tag": "3d15c733-cbae-41dd-b648-31abd3f8680c", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:35.612857 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-8e47b428-93a2-4a46-9fac-ba13c002027e {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:35.613243 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'code': 200} Nov 12 15:03:35.638849 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=3d15c733-cbae-41dd-b648-31abd3f8680c,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:35.753027 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5d02cc4-775f-458b-94fb-ad5a26060efe req-cdfeffa6-57e2-4370-acf5-87f6a408ea15 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:35.754561 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b5d02cc4-775f-458b-94fb-ad5a26060efe req-cdfeffa6-57e2-4370-acf5-87f6a408ea15 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 945 time: 0.0560398 Nov 12 15:03:35.813657 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b5d02cc4-775f-458b-94fb-ad5a26060efe req-17416402-3a9d-4ccd-a883-bae04d1dae95 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0530653 Nov 12 15:03:35.936602 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f7b432-013e-4bf8-bc77-76b9a92e2c77 req-411f84f0-edbb-4907-ad57-a7d310db571e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:35.938078 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-03f7b432-013e-4bf8-bc77-76b9a92e2c77 req-411f84f0-edbb-4907-ad57-a7d310db571e service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 1098 time: 0.0393546 Nov 12 15:03:35.999157 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-03f7b432-013e-4bf8-bc77-76b9a92e2c77 req-ea68fccd-59f4-4af0-b475-b0fe6d4fff13 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0444419 Nov 12 15:03:36.411831 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0922ac04-09e4-426a-9f0a-c0154dd51ecf req-409ec182-61b2-4c0e-b5f9-a0f33c0f1aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:36.413379 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0922ac04-09e4-426a-9f0a-c0154dd51ecf req-409ec182-61b2-4c0e-b5f9-a0f33c0f1aec tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0581357 Nov 12 15:03:36.462638 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0922ac04-09e4-426a-9f0a-c0154dd51ecf req-729b9f73-9554-4c5d-8e8c-b479f8a4c1b8 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423214 Nov 12 15:03:36.933932 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f71e24a-2d40-4ae7-8388-973623d1ae35 req-3c30e24c-42d7-4e0e-831b-d0055029c265 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:36.936009 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8f71e24a-2d40-4ae7-8388-973623d1ae35 req-3c30e24c-42d7-4e0e-831b-d0055029c265 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 945 time: 0.0499663 Nov 12 15:03:36.984789 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8f71e24a-2d40-4ae7-8388-973623d1ae35 req-9c988170-9b4b-4cfb-b928-79bc864011ca tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0429647 Nov 12 15:03:37.591135 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9033a8-874b-4a12-b0de-4e323b68306a req-ece6e2ca-9806-4450-8b20-6716150e857a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:37.596642 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1d9033a8-874b-4a12-b0de-4e323b68306a req-ece6e2ca-9806-4450-8b20-6716150e857a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0567820 Nov 12 15:03:37.647594 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1d9033a8-874b-4a12-b0de-4e323b68306a req-a1e0226b-1e72-4829-9910-136fc78fa8d6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483074 Nov 12 15:03:38.104628 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed1e24ed-32c0-43a8-8d0d-5ac66e994ae0 req-5e9b8f01-5b84-43b5-8e95-09edc101709b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:38.106701 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ed1e24ed-32c0-43a8-8d0d-5ac66e994ae0 req-5e9b8f01-5b84-43b5-8e95-09edc101709b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 945 time: 0.0479195 Nov 12 15:03:38.155521 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-ed1e24ed-32c0-43a8-8d0d-5ac66e994ae0 req-7c6cc07b-c4d0-43ca-b842-3d0b5cc719df tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0423071 Nov 12 15:03:38.275900 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-914e256d-0de6-40b2-83b3-02640c59c43b req-36dada31-d7de-47e8-b282-93d14f882d31 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:38.277422 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-914e256d-0de6-40b2-83b3-02640c59c43b req-36dada31-d7de-47e8-b282-93d14f882d31 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 945 time: 0.0555120 Nov 12 15:03:38.327734 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-914e256d-0de6-40b2-83b3-02640c59c43b req-3a84f9a1-2770-43b6-92c2-c50c523d6978 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0432556 Nov 12 15:03:38.349925 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34380) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:38.535001 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bca2dc45-3991-43f0-8b45-efaa1a595aa3 tempest-TestVolumeBootPattern-887431830 tempest-TestVolumeBootPattern-887431830-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:38.536522 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-bca2dc45-3991-43f0-8b45-efaa1a595aa3 tempest-TestVolumeBootPattern-887431830 tempest-TestVolumeBootPattern-887431830-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 1093 time: 0.1856420 Nov 12 15:03:38.539363 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34392) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:38.543688 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'floatingip': {'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'port_id': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address': '172.20.0.8'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:03:38.565260 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:38.664164 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:38.803679 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Allocated IP 172.27.3.148 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/1da483ee-8ee4-4c68-a35c-d47b4d1de7f7) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:03:38.814064 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416d6956-59be-4051-9b2e-203fa87e4dd8 req-3406ec4a-5b7f-49ec-b491-7944ef803345 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:38.815541 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-416d6956-59be-4051-9b2e-203fa87e4dd8 req-3406ec4a-5b7f-49ec-b491-7944ef803345 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0936434 Nov 12 15:03:38.914999 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-416d6956-59be-4051-9b2e-203fa87e4dd8 req-2820a264-4091-4d8d-b6c6-65349cd14150 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0917194 Nov 12 15:03:38.988989 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.030322 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.111836 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:03:39.116207 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:03:39.120364 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:03:39.148154 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-d6e79b22-cc5d-4dc6-825d-cd3a70124814 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0513861 Nov 12 15:03:39.162002 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'Port': ['ID=1da483ee-8ee4-4c68-a35c-d47b4d1de7f7,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:39.263906 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80786d7d-3634-4820-b36c-01ec1346deb1 req-986b1130-cdd5-45d4-b561-62792d558b89 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:39.265505 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-80786d7d-3634-4820-b36c-01ec1346deb1 req-986b1130-cdd5-45d4-b561-62792d558b89 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.1105738 Nov 12 15:03:39.293233 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34422) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:39.408402 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-80786d7d-3634-4820-b36c-01ec1346deb1 req-0f1bded4-4152-4596-9914-69a7e8912858 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1332524 Nov 12 15:03:39.459297 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8e16a1fe-3a83-441f-9b19-d699bc8fee7d admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.559276 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8e16a1fe-3a83-441f-9b19-d699bc8fee7d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.563528 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-8e16a1fe-3a83-441f-9b19-d699bc8fee7d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.598872 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-8e16a1fe-3a83-441f-9b19-d699bc8fee7d admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=8487d134cfff4c84984508bfd59b2fcf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3037899 Nov 12 15:03:39.600732 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34428) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:39.641155 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e16a1fe-3a83-441f-9b19-d699bc8fee7d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b113412-1d1b-4664-aa4e-c30c301e58f5,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:39.695655 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c4374e1a-1a79-49dc-8ce7-c13d29e1f775 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.721480 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c4374e1a-1a79-49dc-8ce7-c13d29e1f775 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.768632 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c4374e1a-1a79-49dc-8ce7-c13d29e1f775 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.771604 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c4374e1a-1a79-49dc-8ce7-c13d29e1f775 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.772804 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-c4374e1a-1a79-49dc-8ce7-c13d29e1f775 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/8b113412-1d1b-4664-aa4e-c30c301e58f5 HTTP/1.1" status: 204 len: 168 time: 0.1706867 Nov 12 15:03:39.781744 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4374e1a-1a79-49dc-8ce7-c13d29e1f775 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b113412-1d1b-4664-aa4e-c30c301e58f5,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:39.877652 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:39.954597 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.099185 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34442) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:40.120240 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-31cea856-f8a3-4846-b92b-ede60e02c118 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.128325 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.133052 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.212484 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'Port': ['ID=1da483ee-8ee4-4c68-a35c-d47b4d1de7f7,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:40.218808 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-31cea856-f8a3-4846-b92b-ede60e02c118 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.221160 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.223569 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-31cea856-f8a3-4846-b92b-ede60e02c118 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.273350 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-31cea856-f8a3-4846-b92b-ede60e02c118 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=3a71d319ec584a49b07f754ee5e1b62f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1727889 Nov 12 15:03:40.274671 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31cea856-f8a3-4846-b92b-ede60e02c118 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7059ec5d-89ab-4ba4-9090-cd0d5a06b12f,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:40.279424 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34444) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:40.357462 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Floating IP 2d4bc9b7-16dd-4477-b896-c37c245c4b3a associated. External IP: 172.27.3.148, port: 3d15c733-cbae-41dd-b648-31abd3f8680c. Nov 12 15:03:40.409084 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-351a1b8c-0854-4324-aa8e-b8cf2959b865 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.468398 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-351a1b8c-0854-4324-aa8e-b8cf2959b865 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.608714 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc7df5a3-fe02-4402-83ef-8e8dd48bc940 req-59a36c8d-1027-4597-ad08-a240109c9e80 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:40.610178 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bc7df5a3-fe02-4402-83ef-8e8dd48bc940 req-59a36c8d-1027-4597-ad08-a240109c9e80 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.1249251 Nov 12 15:03:40.615908 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-351a1b8c-0854-4324-aa8e-b8cf2959b865 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.618510 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-351a1b8c-0854-4324-aa8e-b8cf2959b865 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.619594 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-351a1b8c-0854-4324-aa8e-b8cf2959b865 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/7059ec5d-89ab-4ba4-9090-cd0d5a06b12f HTTP/1.1" status: 204 len: 168 time: 0.3408074 Nov 12 15:03:40.671056 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-351a1b8c-0854-4324-aa8e-b8cf2959b865 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7059ec5d-89ab-4ba4-9090-cd0d5a06b12f,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:40.715376 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Router 8ec4de9e-dbf9-4aec-bff5-67be839601cd has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:03:40.720203 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bc7df5a3-fe02-4402-83ef-8e8dd48bc940 req-29cef682-e475-404b-98d7-8287a9595c75 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0995545 Nov 12 15:03:40.858589 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-d8d3c05f-caf2-4f68-9544-dcbbd88c9947 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:40.860079 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-d8d3c05f-caf2-4f68-9544-dcbbd88c9947 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67&tenant_id=49070bd2a8b542b3801c73a224b4bba5 HTTP/1.1" status: 200 len: 1098 time: 0.0836391 Nov 12 15:03:40.878934 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:03:40.890823 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] Sync routers for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:03:40.905663 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:03:40.906342 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:03:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:40.925298 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:40.958556 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-61c3ba32-67e4-4536-8c76-84e3ea617cd4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.4181733 Nov 12 15:03:40.959884 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'tag': '3d15c733-cbae-41dd-b648-31abd3f8680c'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:40.962174 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4672353-e4f7-4a34-9293-5e7e68fa9d14" -d '{"events": [{"name": "network-changed", "server_uuid": "b71ba01f-bab4-486f-a7b2-99909d779c41", "tag": "3d15c733-cbae-41dd-b648-31abd3f8680c"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:40.967209 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-fab6d2f2-527a-4c60-8635-25e3b93a0547 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:40.968721 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-fab6d2f2-527a-4c60-8635-25e3b93a0547 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=49070bd2a8b542b3801c73a224b4bba5&device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1098 time: 0.0784085 Nov 12 15:03:40.976058 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34454) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:40.992522 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f5e8bdce-798d-43ee-a5f6-0ed6ce2343ee admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:41.014628 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4aa4e3dc-fa1b-4145-b79a-dd2a9702d2db x-openstack-request-id: req-4aa4e3dc-fa1b-4145-b79a-dd2a9702d2db {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:41.015108 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b71ba01f-bab4-486f-a7b2-99909d779c41", "tag": "3d15c733-cbae-41dd-b648-31abd3f8680c", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:41.015306 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-4aa4e3dc-fa1b-4145-b79a-dd2a9702d2db {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:41.015760 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'tag': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'status': 'completed', 'code': 200} Nov 12 15:03:41.033049 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:03:41.094312 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f5e8bdce-798d-43ee-a5f6-0ed6ce2343ee admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:41.098626 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f5e8bdce-798d-43ee-a5f6-0ed6ce2343ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:41.125718 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e8bdce-798d-43ee-a5f6-0ed6ce2343ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88aebc67-c6b8-418a-805a-a515046c5300,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:41.147819 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-4a99c371-2da1-4b0e-894f-412d9f005fea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:41.149526 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-4a99c371-2da1-4b0e-894f-412d9f005fea service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 1098 time: 0.0823767 Nov 12 15:03:41.157012 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-59bb5326-2794-45f2-9ba7-eb618c97bb3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:41.159246 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-59bb5326-2794-45f2-9ba7-eb618c97bb3a service neutron] 10.222.0.86 "GET /v2.0/networks?id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b HTTP/1.1" status: 200 len: 910 time: 0.1742883 Nov 12 15:03:41.174992 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f5e8bdce-798d-43ee-a5f6-0ed6ce2343ee admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=7b08c67de7304641a99dd28bce9a7867&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1973207 Nov 12 15:03:41.176199 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34462) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:41.255337 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b981f0-13e7-4235-ae0c-f938f1f3277c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:41.291417 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b981f0-13e7-4235-ae0c-f938f1f3277c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:41.292884 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '2d4bc9b7-16dd-4477-b896-c37c245c4b3a', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.148', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 605, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:e9:80:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:03:39Z', 'updated_at': '2021-11-12T15:03:39Z', 'revision_number': 0, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:41.296487 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-9542fa8a-70fb-41b1-9293-9534f5c19066 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ce38b191-8562-4891-b8f8-a8b58d423729 HTTP/1.1" status: 200 len: 1001 time: 0.1260285 Nov 12 15:03:41.321677 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] Checking router: 8ec4de9e-dbf9-4aec-bff5-67be839601cd for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:03:41.331115 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:03:41.331877 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:03:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:41.351497 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-a42ffa24-1c46-44d1-a71b-f57b16ed7b3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:41.353105 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-a42ffa24-1c46-44d1-a71b-f57b16ed7b3f service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.1928897 Nov 12 15:03:41.361985 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2e72828-04ab-4f9e-b4d7-71ad0ea15981 req-9215c031-0119-4ad2-b1e9-bf053687e00b tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:41.363586 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f2e72828-04ab-4f9e-b4d7-71ad0ea15981 req-9215c031-0119-4ad2-b1e9-bf053687e00b tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 945 time: 0.0783522 Nov 12 15:03:41.370439 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-3f918257-32aa-4976-96f9-1042cf80fb04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:41.371972 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-3f918257-32aa-4976-96f9-1042cf80fb04 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=0d076ecb-e243-4855-ace2-0ad087866ab5 HTTP/1.1" status: 200 len: 848 time: 0.0669804 Nov 12 15:03:41.380668 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b981f0-13e7-4235-ae0c-f938f1f3277c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:41.384369 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b981f0-13e7-4235-ae0c-f938f1f3277c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:41.386485 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-05b981f0-13e7-4235-ae0c-f938f1f3277c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/88aebc67-c6b8-418a-805a-a515046c5300 HTTP/1.1" status: 204 len: 168 time: 0.2088368 Nov 12 15:03:41.412655 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b981f0-13e7-4235-ae0c-f938f1f3277c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88aebc67-c6b8-418a-805a-a515046c5300,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:41.431950 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ce38b191-8562-4891-b8f8-a8b58d423729 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:03:41.458003 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f2e72828-04ab-4f9e-b4d7-71ad0ea15981 req-ac329f3d-7cc9-4e64-bb75-d602e6d2a2d6 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696385 Nov 12 15:03:41.461180 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-08f2e5e6-1415-46a8-8621-562995f5c489 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=3d15c733-cbae-41dd-b648-31abd3f8680c HTTP/1.1" status: 200 len: 999 time: 0.0976188 Nov 12 15:03:41.468294 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-149705a5-cad0-4c2e-a80b-9ef0c042fb52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:41.469840 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-149705a5-cad0-4c2e-a80b-9ef0c042fb52 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0644500 Nov 12 15:03:41.507439 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:03:41.566596 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-37b50956-af80-4be0-92b7-f1190d781a41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:41.568050 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-37b50956-af80-4be0-92b7-f1190d781a41 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0973787 Nov 12 15:03:41.626593 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-54a60662-7fd1-48ae-a4fa-d298ce7a95d3 service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1473396 Nov 12 15:03:41.633684 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-4c3ce680-0db3-4987-86c6-89732e35faf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:41.635182 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-4c3ce680-0db3-4987-86c6-89732e35faf5 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0587573 Nov 12 15:03:41.780074 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:41.811045 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-6991b95e-f34f-46b4-8d71-3f9d77ff25d9 req-b89a81b6-5e0f-4d9b-ae70-6e6205f34839 service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1748617 Nov 12 15:03:41.813026 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-ffa82f8a-6de1-4d96-88c8-8cd6563924a6 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1682165 Nov 12 15:03:41.848614 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:41.851294 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-556b8449-fec4-49b7-bdb8-d110775db8ff" -d '{"events": [{"server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "name": "network-vif-unplugged", "status": "completed", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:41.871981 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ce38b191-8562-4891-b8f8-a8b58d423729,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:41.877390 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:41.911753 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7263bf06-46c8-49b8-a09d-9c8dcf7f5ca5 x-openstack-request-id: req-7263bf06-46c8-49b8-a09d-9c8dcf7f5ca5 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:41.912367 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "name": "network-vif-unplugged", "status": "completed", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:41.912367 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-7263bf06-46c8-49b8-a09d-9c8dcf7f5ca5 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:41.912676 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'code': 200} Nov 12 15:03:41.960513 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c352ba1-5072-4f02-b9e7-2ae1c1b344c8 req-d2e7a905-c145-4e51-b0c8-b3b3c9686758 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:41.962048 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1c352ba1-5072-4f02-b9e7-2ae1c1b344c8 req-d2e7a905-c145-4e51-b0c8-b3b3c9686758 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.1293361 Nov 12 15:03:41.968594 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=ce38b191-8562-4891-b8f8-a8b58d423729,revision_number=6']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:41.999523 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '2d4bc9b7-16dd-4477-b896-c37c245c4b3a', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.148', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 605, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:e9:80:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:03:39Z', 'updated_at': '2021-11-12T15:03:39Z', 'revision_number': 0, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:42.021421 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d4672353-e4f7-4a34-9293-5e7e68fa9d14 req-f077d052-188d-4099-80d1-885273e1d00d service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1774044 Nov 12 15:03:42.028902 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3e3a482-27c1-40db-8ee4-2bb027a089fc None None] The sync data for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi is: [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '2d4bc9b7-16dd-4477-b896-c37c245c4b3a', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.148', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 605, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:e9:80:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:03:39Z', 'updated_at': '2021-11-12T15:03:39Z', 'revision_number': 0, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:03:42.053224 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1c352ba1-5072-4f02-b9e7-2ae1c1b344c8 req-4aacc4bc-2b5a-4a30-ac9c-72877775c430 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0790622 Nov 12 15:03:42.229222 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-579fcdbe-1683-44ec-9fd8-be871e7ea9cf None None] New status for floating IP 2d4bc9b7-16dd-4477-b896-c37c245c4b3a: ACTIVE {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:03:42.584926 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9cd8398-3498-4aaa-b7c6-4f48694bc1c7 req-ce9c25ee-5c61-4e78-9a00-9d8e7559dc2f tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:42.586432 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a9cd8398-3498-4aaa-b7c6-4f48694bc1c7 req-ce9c25ee-5c61-4e78-9a00-9d8e7559dc2f tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 945 time: 0.0499043 Nov 12 15:03:42.636396 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a9cd8398-3498-4aaa-b7c6-4f48694bc1c7 req-5cc00726-c7c5-4942-9146-f7849eec8d37 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436330 Nov 12 15:03:43.167318 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ab2d79c-9d21-4fa8-a8a2-f6b6c5201a9a req-33a56359-bd11-49f7-9e31-f91d74ccfb64 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:43.169492 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8ab2d79c-9d21-4fa8-a8a2-f6b6c5201a9a req-33a56359-bd11-49f7-9e31-f91d74ccfb64 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0517259 Nov 12 15:03:43.224694 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8ab2d79c-9d21-4fa8-a8a2-f6b6c5201a9a req-decc0e52-d392-4a28-a086-b762bdedd0c7 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493150 Nov 12 15:03:43.337029 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-a7abae67-e320-4e85-8490-9b7270c97434 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:43.338401 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-a7abae67-e320-4e85-8490-9b7270c97434 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 945 time: 0.0523469 Nov 12 15:03:43.435543 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Deleting port 2d86f4d7-5139-4920-a182-48324fe8a515 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:43.435873 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:43.527515 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34540) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:43.638843 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7bb8bc66-3889-467f-b0b7-c72e9555b104 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:43.751326 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7bb8bc66-3889-467f-b0b7-c72e9555b104 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:43.756848 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7bb8bc66-3889-467f-b0b7-c72e9555b104 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:43.791559 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] For port 2d86f4d7-5139-4920-a182-48324fe8a515, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=2d86f4d7-5139-4920-a182-48324fe8a515,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:43.791921 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:43.800283 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb8bc66-3889-467f-b0b7-c72e9555b104 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb35422a-2f6e-4bbe-9810-21d5a4cd25c0,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:43.805182 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Calling delete_port for 2d86f4d7-5139-4920-a182-48324fe8a515 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:43.811853 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cf67574-894d-45a0-8d04-273b2bc1c9e0 req-c53a6a61-40b6-43b9-a00c-12095e7d4a33 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:43.813398 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6cf67574-894d-45a0-8d04-273b2bc1c9e0 req-c53a6a61-40b6-43b9-a00c-12095e7d4a33 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=1f355e55-39e1-4eb4-a05b-0bb003dddf0d HTTP/1.1" status: 200 len: 945 time: 0.1044750 Nov 12 15:03:43.817361 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-7bb8bc66-3889-467f-b0b7-c72e9555b104 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=0c5c20e2c84e4bb7a704ed3fed4248df&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2882199 Nov 12 15:03:43.818742 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34546) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:43.864321 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-6cf67574-894d-45a0-8d04-273b2bc1c9e0 req-0d785e64-2d97-4f7c-99ed-3972d523ede2 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421488 Nov 12 15:03:43.919400 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d4190183-6f43-43e3-bee6-d9068940965e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:43.964797 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d4190183-6f43-43e3-bee6-d9068940965e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.013591 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.026592 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['80209aed-5240-4dda-915c-40b00a2280c7', 'd7aa8b81-78d7-4f77-a972-d37582c3137e', '1eda655d-6ba3-495a-83dc-b145dcdd306b', '2d86f4d7-5139-4920-a182-48324fe8a515'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:03:44.043278 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Pushing event deleted for resources: {'Port': ['ID=2d86f4d7-5139-4920-a182-48324fe8a515,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:44.073850 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d4190183-6f43-43e3-bee6-d9068940965e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.077084 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d4190183-6f43-43e3-bee6-d9068940965e admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.078230 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d4190183-6f43-43e3-bee6-d9068940965e admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/fb35422a-2f6e-4bbe-9810-21d5a4cd25c0 HTTP/1.1" status: 204 len: 168 time: 0.2585561 Nov 12 15:03:44.094502 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] No DVR routers for this DVR port 2d86f4d7-5139-4920-a182-48324fe8a515 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:03:44.097542 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.100848 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-795143e8-fd3f-46c8-b6db-e3b11e82c0a5 req-087aa13e-b747-4580-857d-6fe3ed6c3a89 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "DELETE /v2.0/ports/2d86f4d7-5139-4920-a182-48324fe8a515 HTTP/1.1" status: 204 len: 173 time: 0.7554355 Nov 12 15:03:44.101297 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1f355e55-39e1-4eb4-a05b-0bb003dddf0d', 'name': 'network-vif-deleted', 'tag': '2d86f4d7-5139-4920-a182-48324fe8a515'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:44.103541 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab9b35be-0325-4a52-bc23-051a7cbe4f03" -d '{"events": [{"server_uuid": "1f355e55-39e1-4eb4-a05b-0bb003dddf0d", "name": "network-vif-deleted", "tag": "2d86f4d7-5139-4920-a182-48324fe8a515"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:44.111736 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4190183-6f43-43e3-bee6-d9068940965e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb35422a-2f6e-4bbe-9810-21d5a4cd25c0,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:44.149041 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2000f42-77f6-4603-b8e6-745b079d452c x-openstack-request-id: req-d2000f42-77f6-4603-b8e6-745b079d452c {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:44.149345 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1f355e55-39e1-4eb4-a05b-0bb003dddf0d", "name": "network-vif-deleted", "tag": "2d86f4d7-5139-4920-a182-48324fe8a515", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:44.149713 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-d2000f42-77f6-4603-b8e6-745b079d452c {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:44.150200 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1f355e55-39e1-4eb4-a05b-0bb003dddf0d', 'name': 'network-vif-deleted', 'tag': '2d86f4d7-5139-4920-a182-48324fe8a515', 'status': 'completed', 'code': 200} Nov 12 15:03:44.348288 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbbd66f1-db26-45c7-b1e0-a8fe9329965e req-bf76bd80-9b25-4a9a-a55b-a5e0e8771264 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:44.356659 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fbbd66f1-db26-45c7-b1e0-a8fe9329965e req-bf76bd80-9b25-4a9a-a55b-a5e0e8771264 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0613599 Nov 12 15:03:44.391701 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34556) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:44.412498 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-fbbd66f1-db26-45c7-b1e0-a8fe9329965e req-37bc9d06-8f06-4f11-bf02-7e51d4289495 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0549395 Nov 12 15:03:44.418766 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b5097a24-333c-4a5d-8003-90b5a0f9a616 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.495734 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b5097a24-333c-4a5d-8003-90b5a0f9a616 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.500329 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b5097a24-333c-4a5d-8003-90b5a0f9a616 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.538481 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b5097a24-333c-4a5d-8003-90b5a0f9a616 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=51b232c8063748f5938839884c675481&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1456470 Nov 12 15:03:44.539638 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5097a24-333c-4a5d-8003-90b5a0f9a616 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f0419de-e39d-4e61-a0d3-a6bc3ddb5119,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:44.541410 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34558) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:44.596324 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c28f60d6-c535-44a0-9803-57949f4a0816 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.617540 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c28f60d6-c535-44a0-9803-57949f4a0816 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.669438 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c28f60d6-c535-44a0-9803-57949f4a0816 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.673117 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c28f60d6-c535-44a0-9803-57949f4a0816 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:44.674773 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-c28f60d6-c535-44a0-9803-57949f4a0816 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1f0419de-e39d-4e61-a0d3-a6bc3ddb5119 HTTP/1.1" status: 204 len: 168 time: 0.1321328 Nov 12 15:03:44.683804 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c28f60d6-c535-44a0-9803-57949f4a0816 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f0419de-e39d-4e61-a0d3-a6bc3ddb5119,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:45.345774 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34586) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:45.439458 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-322154576-network', 'tenant_id': 'e34beb53754642b98d82047c9a2ad3bf'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:03:45.460876 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Made reservation on behalf of e34beb53754642b98d82047c9a2ad3bf for: {'network': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:03:45.463204 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:45.472240 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:45.551704 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-639e80dd-0562-4047-a991-4ab13af631dc req-bdcfab0b-acc9-4a56-af33-ad1ebbf17c96 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:45.553270 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-639e80dd-0562-4047-a991-4ab13af631dc req-bdcfab0b-acc9-4a56-af33-ad1ebbf17c96 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0706906 Nov 12 15:03:45.619955 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:45.625524 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:45.636402 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-639e80dd-0562-4047-a991-4ab13af631dc req-e0cbe547-8f59-426c-b2ac-b58c309bc1ba tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0759165 Nov 12 15:03:45.656508 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 638} {{(pid=101617) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 15:03:45.666456 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=980118b4-3b83-4659-b34e-ba2e887f5a09,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:45.671830 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:45.672515 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.segments_db [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Added segment 75cc0c76-b8c8-4f11-9354-d576f37b5f15 of type vlan for network 1423bfa2-0088-45e3-8005-bf4cea9c5471 Nov 12 15:03:45.713116 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:45.737946 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:45.738880 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:45.739460 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:45.797036 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.4501350 Nov 12 15:03:45.800154 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34592) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:45.804090 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71002bdd-9c1e-4915-b2e9-151931502f88 admin admin] Pushing event updated for resources: {'Network': ['ID=1423bfa2-0088-45e3-8005-bf4cea9c5471,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:45.805299 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Request body: {'subnet': {'network_id': '1423bfa2-0088-45e3-8005-bf4cea9c5471', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-322154576-subnet', 'tenant_id': 'e34beb53754642b98d82047c9a2ad3bf', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:03:45.816482 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 1423bfa2-0088-45e3-8005-bf4cea9c5471 details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 15:03:45.830309 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Made reservation on behalf of e34beb53754642b98d82047c9a2ad3bf for: {'subnet': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:03:45.832887 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5528411'] for subnet, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:45.999745 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5822845', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5528393'] for subnet, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.059656 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Pushing event updated for resources: {'Subnet': ['ID=10815258-aa77-4d03-8cf6-3b6890668b39,revision_number=0']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:46.066037 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Checking segment: {'id': '75cc0c76-b8c8-4f11-9354-d576f37b5f15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 638, 'network_id': '1423bfa2-0088-45e3-8005-bf4cea9c5471'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:03:46.066345 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Network hostable DHCP agents. Network: 1423bfa2-0088-45e3-8005-bf4cea9c5471, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101618) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 15:03:46.084871 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Network 1423bfa2-0088-45e3-8005-bf4cea9c5471 is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101618) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 15:03:46.094473 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 1423bfa2-0088-45e3-8005-bf4cea9c5471) {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:03:46.100008 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:46.100924 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.106972 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a4a44b4-812f-4cf9-ac9f-a52bff9ec762 None None] Network 1423bfa2-0088-45e3-8005-bf4cea9c5471 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:03:46.127657 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-4594e3c8-2e89-466a-9b6b-9d92c17a399e admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3258948 Nov 12 15:03:46.271757 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-829b2499-9ef3-4ea0-8ed0-1a179e4646f2 None None] Network 1423bfa2-0088-45e3-8005-bf4cea9c5471 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:03:46.282083 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75a8b327-1f52-4e4d-9941-69c63a649831 req-33a41202-45d3-4d0e-a397-995aa165a97f tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:46.283682 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-75a8b327-1f52-4e4d-9941-69c63a649831 req-33a41202-45d3-4d0e-a397-995aa165a97f tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 946 time: 0.0520227 Nov 12 15:03:46.344722 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-75a8b327-1f52-4e4d-9941-69c63a649831 req-bdfbcfbc-4c9f-4712-a2de-578061ec59f5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542791 Nov 12 15:03:46.615487 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34614) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:46.620425 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-803620301-network', 'tenant_id': '1c943180b20e4981abd25afcd5d9607a'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:03:46.641127 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Made reservation on behalf of 1c943180b20e4981abd25afcd5d9607a for: {'network': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:03:46.643532 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for network, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.652174 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.767372 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.774306 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.789612 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d28b78d-9864-4143-a4e0-c8da5e3fd769 req-26a4e2b4-e343-4266-b2f3-b8a19ef57122 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:46.791081 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d28b78d-9864-4143-a4e0-c8da5e3fd769 req-26a4e2b4-e343-4266-b2f3-b8a19ef57122 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0806994 Nov 12 15:03:46.823593 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 645} {{(pid=101618) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 12 15:03:46.836185 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f902e1f-bc2a-4f75-83f0-4906151b5c5a,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:46.844845 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.845061 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.segments_db [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Added segment 092d3108-fda3-4bfa-845a-ebef5b9fc44b of type vlan for network 1e448037-e153-45f4-b010-eab2916ba26b Nov 12 15:03:46.902754 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5d28b78d-9864-4143-a4e0-c8da5e3fd769 req-7d438c82-995c-49a0-b65c-cb6d2f846b7a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1028488 Nov 12 15:03:46.906118 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8744642106597'] for network, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.930746 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182'] for network, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.931729 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:46.932337 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:46.991375 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3747318 Nov 12 15:03:46.994256 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34618) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:46.998599 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5dfd5e-f514-4248-88be-5a60009eba79 admin admin] Pushing event updated for resources: {'Network': ['ID=1e448037-e153-45f4-b010-eab2916ba26b,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:46.999357 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Request body: {'subnet': {'network_id': '1e448037-e153-45f4-b010-eab2916ba26b', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-803620301-subnet', 'tenant_id': '1c943180b20e4981abd25afcd5d9607a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:03:47.008055 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Network 1e448037-e153-45f4-b010-eab2916ba26b details requested by agent ovs-agent-dv-cinder-776422-5-iscsi with host dv-cinder-776422-5-iscsi {{(pid=101619) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 12 15:03:47.020609 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Made reservation on behalf of 1c943180b20e4981abd25afcd5d9607a for: {'subnet': 1} {{(pid=101617) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:03:47.022827 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5175757'] for subnet, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:47.187180 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-7428832', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5175775'] for subnet, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:47.241191 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Pushing event updated for resources: {'Subnet': ['ID=de53e437-c71d-4c2d-a779-5f67bd9bfc88,revision_number=0']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:47.248377 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Checking segment: {'id': '092d3108-fda3-4bfa-845a-ebef5b9fc44b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 645, 'network_id': '1e448037-e153-45f4-b010-eab2916ba26b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101617) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:03:47.248726 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Network hostable DHCP agents. Network: 1e448037-e153-45f4-b010-eab2916ba26b, hostable agents: ['7a4819af-8336-40ad-b4e4-47c51a8cfa46'], hosted agents: [] {{(pid=101617) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 12 15:03:47.265137 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Network 1e448037-e153-45f4-b010-eab2916ba26b is scheduled to be hosted by DHCP agent 7a4819af-8336-40ad-b4e4-47c51a8cfa46 with binding_index 1 {{(pid=101617) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 12 15:03:47.273554 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-776422-5-iscsi, 1e448037-e153-45f4-b010-eab2916ba26b) {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:03:47.278546 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:47.279719 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:47.282722 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33d15bdd-02c0-4d1b-88a3-9feae4cef866 None None] Network 1e448037-e153-45f4-b010-eab2916ba26b requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:03:47.296073 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-e2300e8f-73ff-4c0e-8fda-37fd7a3a4930 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3006592 Nov 12 15:03:47.414288 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9be75e83-726a-4152-a1df-0513edf25217 None None] Network 1e448037-e153-45f4-b010-eab2916ba26b requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:03:47.465768 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbfc1136-2163-4ac1-8650-535736a3a0e0 req-cae470bc-ccc8-47e0-b7cf-145bf94dbddb tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:47.467294 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cbfc1136-2163-4ac1-8650-535736a3a0e0 req-cae470bc-ccc8-47e0-b7cf-145bf94dbddb tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 946 time: 0.0554605 Nov 12 15:03:47.486512 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 2d86f4d7-5139-4920-a182-48324fe8a515 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:03:47.516592 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-cbfc1136-2163-4ac1-8650-535736a3a0e0 req-7f0a7b82-60e2-4b10-b95f-028b573e2a55 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430191 Nov 12 15:03:47.522354 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 2d86f4d7-5139-4920-a182-48324fe8a515 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:03:47.522698 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 2d86f4d7-5139-4920-a182-48324fe8a515 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:03:48.020743 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-356ad599-c7d6-4917-87ef-a63c4a44fef7 req-28147400-6d42-4c8f-b402-1d614eecc63f tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:48.022265 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-356ad599-c7d6-4917-87ef-a63c4a44fef7 req-28147400-6d42-4c8f-b402-1d614eecc63f tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0522342 Nov 12 15:03:48.107310 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-356ad599-c7d6-4917-87ef-a63c4a44fef7 req-3b4a9aa9-d77a-4713-99fb-6ee2d1f5bb1e tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0789313 Nov 12 15:03:48.119536 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-e63c99a6-6362-46ef-9832-1d1b4b8f6e62 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:48.121043 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-e63c99a6-6362-46ef-9832-1d1b4b8f6e62 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 946 time: 0.0765357 Nov 12 15:03:48.238150 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Deleting port 1eda655d-6ba3-495a-83dc-b145dcdd306b {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:48.238481 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:48.304379 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f127d46-c218-49c2-ba02-a9c7ebf5cd8e req-f81c0e13-9af0-4f3e-a8ec-9f4756d937d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:48.305859 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0f127d46-c218-49c2-ba02-a9c7ebf5cd8e req-f81c0e13-9af0-4f3e-a8ec-9f4756d937d9 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1096 time: 0.0968146 Nov 12 15:03:48.358327 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] For port 1eda655d-6ba3-495a-83dc-b145dcdd306b, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1eda655d-6ba3-495a-83dc-b145dcdd306b,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:48.358606 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:48.380168 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Calling delete_port for 1eda655d-6ba3-495a-83dc-b145dcdd306b owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:48.386220 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-0f127d46-c218-49c2-ba02-a9c7ebf5cd8e req-ac8ec9d7-b30f-4ffb-bdcf-39cfd4889ca7 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0716729 Nov 12 15:03:48.509142 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:48.521113 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['80209aed-5240-4dda-915c-40b00a2280c7', 'd7aa8b81-78d7-4f77-a972-d37582c3137e', '1eda655d-6ba3-495a-83dc-b145dcdd306b'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:03:48.536426 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Pushing event deleted for resources: {'Port': ['ID=1eda655d-6ba3-495a-83dc-b145dcdd306b,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:48.580836 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] No DVR routers for this DVR port 1eda655d-6ba3-495a-83dc-b145dcdd306b on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:03:48.583387 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:48.586856 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-07daa7e4-0f69-4c95-80ab-9868a1ce6031 req-c02a1f3e-b9db-4634-bc5c-a5c959c52aa5 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "DELETE /v2.0/ports/1eda655d-6ba3-495a-83dc-b145dcdd306b HTTP/1.1" status: 204 len: 173 time: 0.4593706 Nov 12 15:03:48.587313 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '23399178-4e26-4d44-9cfe-f494b8281806', 'name': 'network-vif-deleted', 'tag': '1eda655d-6ba3-495a-83dc-b145dcdd306b'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:48.590144 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9792284-136c-467f-bc4e-5f7a99c3bfcd" -d '{"events": [{"server_uuid": "23399178-4e26-4d44-9cfe-f494b8281806", "name": "network-vif-deleted", "tag": "1eda655d-6ba3-495a-83dc-b145dcdd306b"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:48.634914 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-3868f213-941c-4b25-8f51-f01d77ce192d req-10befdc3-9a9e-4258-8607-f62707608c29 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=23399178-4e26-4d44-9cfe-f494b8281806 HTTP/1.1" status: 200 len: 210 time: 0.0305190 Nov 12 15:03:48.635537 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4d75f6a-870a-468b-8bb5-5d955c07998e x-openstack-request-id: req-a4d75f6a-870a-468b-8bb5-5d955c07998e {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:48.636085 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "23399178-4e26-4d44-9cfe-f494b8281806", "name": "network-vif-deleted", "tag": "1eda655d-6ba3-495a-83dc-b145dcdd306b", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:48.636362 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-a4d75f6a-870a-468b-8bb5-5d955c07998e {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:48.636973 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '23399178-4e26-4d44-9cfe-f494b8281806', 'name': 'network-vif-deleted', 'tag': '1eda655d-6ba3-495a-83dc-b145dcdd306b', 'status': 'completed', 'code': 200} Nov 12 15:03:49.234388 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e014bec7-639f-4c05-bbf8-16902f055054 req-1aa8eb73-2088-401c-adaa-9bb9ebb25c12 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:49.235870 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e014bec7-639f-4c05-bbf8-16902f055054 req-1aa8eb73-2088-401c-adaa-9bb9ebb25c12 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 943 time: 0.0540850 Nov 12 15:03:49.289765 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e014bec7-639f-4c05-bbf8-16902f055054 req-3a273057-4c2e-4ea0-89f4-bfa3e3e33de2 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474539 Nov 12 15:03:49.498779 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ce38b191-8562-4891-b8f8-a8b58d423729 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:03:49.597324 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ce38b191-8562-4891-b8f8-a8b58d423729,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:49.609122 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'port_id': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'mac_address': 'fa:16:3e:5b:04:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 623, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:03:49.647468 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:49.659900 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ce38b191-8562-4891-b8f8-a8b58d423729 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:03:49.682174 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ce38b191-8562-4891-b8f8-a8b58d423729,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:49.689079 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:49.738174 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=ce38b191-8562-4891-b8f8-a8b58d423729,revision_number=7']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:49.917722 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98c47ce-fa1e-48ac-bff3-2ee2be56bc5e req-4c4227cc-5ddf-4df9-b1dd-c2be3ef499d7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:49.920242 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e98c47ce-fa1e-48ac-bff3-2ee2be56bc5e req-4c4227cc-5ddf-4df9-b1dd-c2be3ef499d7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 946 time: 0.0508232 Nov 12 15:03:49.975046 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['ce38b191-8562-4891-b8f8-a8b58d423729'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:03:49.977720 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-e98c47ce-fa1e-48ac-bff3-2ee2be56bc5e req-5bdf277b-45f7-49da-bb45-1572e108c586 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512881 Nov 12 15:03:50.413048 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f65fa10-8318-4772-b361-e6f5ce0a2572 req-b44736a9-ef72-4169-a794-67b0c5709479 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:50.414550 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3f65fa10-8318-4772-b361-e6f5ce0a2572 req-b44736a9-ef72-4169-a794-67b0c5709479 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 944 time: 0.0528653 Nov 12 15:03:50.470665 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3f65fa10-8318-4772-b361-e6f5ce0a2572 req-9106ea34-1b34-4fd1-a25e-b2eeb13d5ba6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493221 Nov 12 15:03:51.098069 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af98b2d-0dc8-46e2-87be-53dd90cc589e req-783981ce-2d55-4b11-bd57-bdc6fe361937 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:51.099625 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0af98b2d-0dc8-46e2-87be-53dd90cc589e req-783981ce-2d55-4b11-bd57-bdc6fe361937 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 946 time: 0.0535076 Nov 12 15:03:51.148168 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0af98b2d-0dc8-46e2-87be-53dd90cc589e req-d97aefa1-a472-4df0-8ec6-ab2a98e5ebc8 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418038 Nov 12 15:03:51.405193 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-d5c0683b-6429-4d42-88d9-6b3610834831 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:51.406587 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-d5c0683b-6429-4d42-88d9-6b3610834831 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 946 time: 0.0480096 Nov 12 15:03:51.503938 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Deleting port d7aa8b81-78d7-4f77-a972-d37582c3137e {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:51.504788 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:51.515312 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ce38b191-8562-4891-b8f8-a8b58d423729 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:03:51.568573 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port ce38b191-8562-4891-b8f8-a8b58d423729 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:03:51.568947 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:51.608389 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] For port d7aa8b81-78d7-4f77-a972-d37582c3137e, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=d7aa8b81-78d7-4f77-a972-d37582c3137e,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:51.608757 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:51.625791 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Calling delete_port for d7aa8b81-78d7-4f77-a972-d37582c3137e owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:51.650078 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:51.678394 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:51.680828 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17a2c6a1-11b7-4b7b-bf33-3b12a0ea4fdd" -d '{"events": [{"server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "name": "network-vif-plugged", "status": "completed", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:51.699855 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ce38b191-8562-4891-b8f8-a8b58d423729,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:51.705587 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:51.706529 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1eda655d-6ba3-495a-83dc-b145dcdd306b no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:03:51.731101 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd46ac29-cd9d-472c-a27b-31898c8beee9 x-openstack-request-id: req-dd46ac29-cd9d-472c-a27b-31898c8beee9 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:51.731461 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "name": "network-vif-plugged", "status": "completed", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:51.731753 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-dd46ac29-cd9d-472c-a27b-31898c8beee9 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:51.732172 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'code': 200} Nov 12 15:03:51.734246 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 1eda655d-6ba3-495a-83dc-b145dcdd306b {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:03:51.736456 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1eda655d-6ba3-495a-83dc-b145dcdd306b not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:03:51.783955 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=ce38b191-8562-4891-b8f8-a8b58d423729,revision_number=8']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:51.790367 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:51.802265 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['80209aed-5240-4dda-915c-40b00a2280c7', 'd7aa8b81-78d7-4f77-a972-d37582c3137e'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:03:51.824222 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Pushing event deleted for resources: {'Port': ['ID=d7aa8b81-78d7-4f77-a972-d37582c3137e,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:51.867456 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] No DVR routers for this DVR port d7aa8b81-78d7-4f77-a972-d37582c3137e on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:03:51.870317 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:51.874572 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-511c4d28-b2aa-4cf8-8adb-2e1a48a2be38 req-bc94600d-7395-4d95-9472-3e3906160049 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "DELETE /v2.0/ports/d7aa8b81-78d7-4f77-a972-d37582c3137e HTTP/1.1" status: 204 len: 173 time: 0.4615345 Nov 12 15:03:51.874950 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fa4a8913-d092-41fa-ba8e-037034fa36ca', 'name': 'network-vif-deleted', 'tag': 'd7aa8b81-78d7-4f77-a972-d37582c3137e'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:51.877378 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d267bad2-0f22-4a72-8494-4c569e3cbaf4" -d '{"events": [{"server_uuid": "fa4a8913-d092-41fa-ba8e-037034fa36ca", "name": "network-vif-deleted", "tag": "d7aa8b81-78d7-4f77-a972-d37582c3137e"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:51.916329 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4da06ecb-a9f4-4097-ae9e-424edac05b6a x-openstack-request-id: req-4da06ecb-a9f4-4097-ae9e-424edac05b6a {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:51.916624 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fa4a8913-d092-41fa-ba8e-037034fa36ca", "name": "network-vif-deleted", "tag": "d7aa8b81-78d7-4f77-a972-d37582c3137e", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:51.916872 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-4da06ecb-a9f4-4097-ae9e-424edac05b6a {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:51.917270 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fa4a8913-d092-41fa-ba8e-037034fa36ca', 'name': 'network-vif-deleted', 'tag': 'd7aa8b81-78d7-4f77-a972-d37582c3137e', 'status': 'completed', 'code': 200} Nov 12 15:03:52.099043 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-eca25d38-40a3-47c2-91e5-0ebe35ef24d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:52.252429 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1da870f5-11b2-4a55-b5bd-dbc6bfa29fe1 req-7de744cc-3a9b-4dd9-a1ae-8f4284b2068e tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=fa4a8913-d092-41fa-ba8e-037034fa36ca HTTP/1.1" status: 200 len: 210 time: 0.0264130 Nov 12 15:03:54.551112 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-cd51a058-1b21-493b-b167-caab97121866 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:54.647407 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d25a7cd-7e8a-4975-8917-298d9ace7a2d req-5c899c50-c72d-4152-8ab5-77e26fa66ff7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:54.648881 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0d25a7cd-7e8a-4975-8917-298d9ace7a2d req-5c899c50-c72d-4152-8ab5-77e26fa66ff7 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 945 time: 0.0509629 Nov 12 15:03:54.696378 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0d25a7cd-7e8a-4975-8917-298d9ace7a2d req-7c27c98a-7803-49f8-8131-948b1d4e583c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413313 Nov 12 15:03:55.546612 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d7aa8b81-78d7-4f77-a972-d37582c3137e no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:03:55.570635 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: d7aa8b81-78d7-4f77-a972-d37582c3137e {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:03:55.571359 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device d7aa8b81-78d7-4f77-a972-d37582c3137e not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:03:55.579951 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:55.825386 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa298e7a-b377-4203-9f6d-af6b7f848749 req-5060524c-7f9a-44ec-a109-1406a0e0d765 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:55.826822 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa298e7a-b377-4203-9f6d-af6b7f848749 req-5060524c-7f9a-44ec-a109-1406a0e0d765 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 945 time: 0.0561576 Nov 12 15:03:55.874493 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa298e7a-b377-4203-9f6d-af6b7f848749 req-dbdd660c-ecad-4646-9e7f-683a62060aae tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/security-groups?id=539cc6ba-204a-40d6-ad9e-2c68855faf0e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416579 Nov 12 15:03:56.324982 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-25905278-066d-42d5-977e-e01e1648e752 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:03:56.326400 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-25905278-066d-42d5-977e-e01e1648e752 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 945 time: 0.0516543 Nov 12 15:03:56.423219 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Deleting port 80209aed-5240-4dda-915c-40b00a2280c7 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:03:56.423558 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:56.513544 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] For port 80209aed-5240-4dda-915c-40b00a2280c7, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=80209aed-5240-4dda-915c-40b00a2280c7,segment=NetworkSegment(8468f3e5-d352-48c2-8969-f6c1eb1e52f6),segment_id=8468f3e5-d352-48c2-8969-f6c1eb1e52f6)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:03:56.513917 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:56.528744 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Calling delete_port for 80209aed-5240-4dda-915c-40b00a2280c7 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:03:56.662808 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:56.685555 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['80209aed-5240-4dda-915c-40b00a2280c7'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:03:56.697303 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Pushing event deleted for resources: {'Port': ['ID=80209aed-5240-4dda-915c-40b00a2280c7,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:56.740783 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] No DVR routers for this DVR port 80209aed-5240-4dda-915c-40b00a2280c7 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:03:56.743316 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:56.747145 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e0c8cabb-fcba-4830-ab43-864562b35fbc req-b2878724-8f34-4bcf-8250-ddaf1fcdb933 tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.86 "DELETE /v2.0/ports/80209aed-5240-4dda-915c-40b00a2280c7 HTTP/1.1" status: 204 len: 173 time: 0.4104946 Nov 12 15:03:56.747589 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '55ae80dd-c881-495d-b393-37f714977cb2', 'name': 'network-vif-deleted', 'tag': '80209aed-5240-4dda-915c-40b00a2280c7'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:03:56.749914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-079d710a-fcd9-4b87-b656-fc03e71a6ec4" -d '{"events": [{"server_uuid": "55ae80dd-c881-495d-b393-37f714977cb2", "name": "network-vif-deleted", "tag": "80209aed-5240-4dda-915c-40b00a2280c7"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:03:56.795250 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:03:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0eadc59d-d535-4210-91fe-a96d6bd5b754 x-openstack-request-id: req-0eadc59d-d535-4210-91fe-a96d6bd5b754 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:03:56.795250 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "55ae80dd-c881-495d-b393-37f714977cb2", "name": "network-vif-deleted", "tag": "80209aed-5240-4dda-915c-40b00a2280c7", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:03:56.795250 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-0eadc59d-d535-4210-91fe-a96d6bd5b754 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:03:56.795250 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '55ae80dd-c881-495d-b393-37f714977cb2', 'name': 'network-vif-deleted', 'tag': '80209aed-5240-4dda-915c-40b00a2280c7', 'status': 'completed', 'code': 200} Nov 12 15:03:56.967448 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:56.989306 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ed4af1ad-e3b5-49a6-929c-2366f18d738e req-5f02750c-7a6b-4239-ad85-98324f88271c tempest-AttachVolumeNegativeTest-973151295 tempest-AttachVolumeNegativeTest-973151295-project] 10.222.0.61 "GET /v2.0/ports?device_id=55ae80dd-c881-495d-b393-37f714977cb2 HTTP/1.1" status: 200 len: 210 time: 0.0270309 Nov 12 15:03:57.925558 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.061488 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34756) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:58.112908 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-2f3286e2-4345-4af3-bc5d-1ce5031f68a9 admin admin] Deleting subnet 6c234914-5201-4acb-90e6-43368a9bb837 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:03:58.116077 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2f3286e2-4345-4af3-bc5d-1ce5031f68a9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.152675 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2f3286e2-4345-4af3-bc5d-1ce5031f68a9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.192582 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2f3286e2-4345-4af3-bc5d-1ce5031f68a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.244533 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2f3286e2-4345-4af3-bc5d-1ce5031f68a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.272949 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3286e2-4345-4af3-bc5d-1ce5031f68a9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6c234914-5201-4acb-90e6-43368a9bb837,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:58.277877 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2f3286e2-4345-4af3-bc5d-1ce5031f68a9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.282160 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-2f3286e2-4345-4af3-bc5d-1ce5031f68a9 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/6c234914-5201-4acb-90e6-43368a9bb837 HTTP/1.1" status: 204 len: 168 time: 0.2196643 Nov 12 15:03:58.284640 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34758) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:58.336166 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:03:58.351524 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.431195 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.450756 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b3def5d6-542f-430c-929b-c115bf33a381']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:58.459709 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8468f3e5-d352-48c2-8969-f6c1eb1e52f6') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:58.460003 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8468f3e5-d352-48c2-8969-f6c1eb1e52f6') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:03:58.469749 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.482483 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.488226 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] Releasing vlan 625 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:03:58.488579 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:03:58.490223 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:03:58.544195 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.549334 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.552548 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] 10.222.0.61 "DELETE /v2.0/networks/b3def5d6-542f-430c-929b-c115bf33a381 HTTP/1.1" status: 204 len: 168 time: 0.2669151 Nov 12 15:03:58.563356 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03541cb4-fa77-4291-9ad0-4d172652a347 admin admin] Pushing event deleted for resources: {'Network': ['ID=b3def5d6-542f-430c-929b-c115bf33a381,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:58.711934 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34762) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:58.754608 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-2f3bb7b2-ca7d-4d95-ae78-7f3c6100380a admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=4a3b37db0a5944228023e883b9a67692&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0414453 Nov 12 15:03:58.757257 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34764) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:03:58.805142 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1a7d0c5b-15e7-4386-8fd9-4d3e772be626 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.829803 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1a7d0c5b-15e7-4386-8fd9-4d3e772be626 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.874885 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1a7d0c5b-15e7-4386-8fd9-4d3e772be626 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.877627 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1a7d0c5b-15e7-4386-8fd9-4d3e772be626 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:03:58.878857 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-1a7d0c5b-15e7-4386-8fd9-4d3e772be626 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/539cc6ba-204a-40d6-ad9e-2c68855faf0e HTTP/1.1" status: 204 len: 168 time: 0.1205792 Nov 12 15:03:58.886842 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a7d0c5b-15e7-4386-8fd9-4d3e772be626 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=539cc6ba-204a-40d6-ad9e-2c68855faf0e,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:03:59.565340 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 80209aed-5240-4dda-915c-40b00a2280c7 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:03:59.585963 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 80209aed-5240-4dda-915c-40b00a2280c7 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:03:59.586199 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 80209aed-5240-4dda-915c-40b00a2280c7 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:04:00.780874 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34844) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:00.826043 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_v2 [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Deleting subnet 10815258-aa77-4d03-8cf6-3b6890668b39 {{(pid=101618) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:04:00.829324 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:00.862996 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4364798'] for subnet, precommit_delete_associations {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:00.901298 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:00.956946 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5822906', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5528368'] for subnet, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:00.982919 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=10815258-aa77-4d03-8cf6-3b6890668b39,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:00.985689 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:00.988540 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/10815258-aa77-4d03-8cf6-3b6890668b39 HTTP/1.1" status: 204 len: 168 time: 0.2065227 Nov 12 15:04:00.991269 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34846) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:01.002582 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.002924 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.003257 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.003580 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.003901 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.004251 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.004577 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.004897 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.005218 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.005600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.005962 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.006271 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33a4c3e7-7b2c-43e8-a360-69f16847c898 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:01.068094 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.148136 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.167637 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1423bfa2-0088-45e3-8005-bf4cea9c5471']}} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:04:01.177399 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '75cc0c76-b8c8-4f11-9354-d576f37b5f15') {'for_net_delete': True} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:04:01.177733 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '75cc0c76-b8c8-4f11-9354-d576f37b5f15') {} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:04:01.187576 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4359949'] for segment, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.200322 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.205980 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] Releasing vlan 638 on physical network physnet1 to pool {{(pid=101618) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:04:01.206590 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5822932'] for segment, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: Traceback (most recent call last): Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: timer() Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: cb(*args, **kw) Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: return func(*args, **kwargs) Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: self._notify() Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: self.callback(batched_events) Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: event.method(event) Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: return f(self, *a, **k) Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._get(url).json() Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: return self.request(url, 'GET', **kwargs) Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:04:01.208438 dv-cinder-776422-5-iscsi neutron-server[101618]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:04:01.266255 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.271408 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.274529 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] 10.222.0.61 "DELETE /v2.0/networks/1423bfa2-0088-45e3-8005-bf4cea9c5471 HTTP/1.1" status: 204 len: 168 time: 0.2823691 Nov 12 15:04:01.277522 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34848) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:01.285462 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c84b29d6-dbf5-4821-8d7e-42a143bb1ef7 admin admin] Pushing event deleted for resources: {'Network': ['ID=1423bfa2-0088-45e3-8005-bf4cea9c5471,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:01.322029 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-4dc986a4-4b7d-47e9-9130-0f8d1dfddef1 admin admin] Deleting subnet de53e437-c71d-4c2d-a779-5f67bd9bfc88 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:04:01.325235 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4dc986a4-4b7d-47e9-9130-0f8d1dfddef1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.360921 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4dc986a4-4b7d-47e9-9130-0f8d1dfddef1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.398181 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4dc986a4-4b7d-47e9-9130-0f8d1dfddef1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.454359 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4dc986a4-4b7d-47e9-9130-0f8d1dfddef1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.481749 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dc986a4-4b7d-47e9-9130-0f8d1dfddef1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=de53e437-c71d-4c2d-a779-5f67bd9bfc88,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:01.484429 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4dc986a4-4b7d-47e9-9130-0f8d1dfddef1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.491249 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-4dc986a4-4b7d-47e9-9130-0f8d1dfddef1 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/de53e437-c71d-4c2d-a779-5f67bd9bfc88 HTTP/1.1" status: 204 len: 168 time: 0.2113178 Nov 12 15:04:01.491356 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34852) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:01.577271 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.674600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.701832 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1e448037-e153-45f4-b010-eab2916ba26b']}} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:04:01.713851 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '092d3108-fda3-4bfa-845a-ebef5b9fc44b') {'for_net_delete': True} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:04:01.714742 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '092d3108-fda3-4bfa-845a-ebef5b9fc44b') {} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:04:01.727379 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4359949'] for segment, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.741425 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.748801 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] Releasing vlan 645 on physical network physnet1 to pool {{(pid=101618) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:04:01.749205 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5822932'] for segment, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: Traceback (most recent call last): Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: timer() Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: cb(*args, **kw) Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: return func(*args, **kwargs) Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: self._notify() Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: self.callback(batched_events) Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: event.method(event) Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: return f(self, *a, **k) Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._get(url).json() Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: return self.request(url, 'GET', **kwargs) Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:04:01.751148 dv-cinder-776422-5-iscsi neutron-server[101618]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:04:01.821415 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.826771 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:01.830093 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] 10.222.0.61 "DELETE /v2.0/networks/1e448037-e153-45f4-b010-eab2916ba26b HTTP/1.1" status: 204 len: 168 time: 0.3380783 Nov 12 15:04:01.843435 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b965cf3-b477-4387-a5b3-437d7ba79c9c admin admin] Pushing event deleted for resources: {'Network': ['ID=1e448037-e153-45f4-b010-eab2916ba26b,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:02.005359 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34880) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:02.046482 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-88eee72e-feca-4ecf-ab6c-35ece287c9a7 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e34beb53754642b98d82047c9a2ad3bf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0399637 Nov 12 15:04:02.049509 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34882) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:02.112121 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ae38695c-e383-431f-aefe-726294c3307c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:02.133689 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ae38695c-e383-431f-aefe-726294c3307c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:02.181287 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ae38695c-e383-431f-aefe-726294c3307c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:02.183817 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ae38695c-e383-431f-aefe-726294c3307c admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:02.185630 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-ae38695c-e383-431f-aefe-726294c3307c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/980118b4-3b83-4659-b34e-ba2e887f5a09 HTTP/1.1" status: 204 len: 168 time: 0.1349111 Nov 12 15:04:02.193845 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae38695c-e383-431f-aefe-726294c3307c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=980118b4-3b83-4659-b34e-ba2e887f5a09,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:02.499622 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34888) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:02.548596 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-40cc9642-1c3f-41cc-80c5-3e95ab50bd3b admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=1c943180b20e4981abd25afcd5d9607a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0476394 Nov 12 15:04:02.551295 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34890) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:02.598580 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4ae2a320-0e77-43df-b7b2-19b1b340c012 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:02.619594 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4ae2a320-0e77-43df-b7b2-19b1b340c012 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:02.665876 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4ae2a320-0e77-43df-b7b2-19b1b340c012 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:02.668573 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4ae2a320-0e77-43df-b7b2-19b1b340c012 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:02.669712 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-4ae2a320-0e77-43df-b7b2-19b1b340c012 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/0f902e1f-bc2a-4f75-83f0-4906151b5c5a HTTP/1.1" status: 204 len: 168 time: 0.1175225 Nov 12 15:04:02.677691 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ae2a320-0e77-43df-b7b2-19b1b340c012 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f902e1f-bc2a-4f75-83f0-4906151b5c5a,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:03.339820 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34906) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:03.444078 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-405097d8-edc8-427c-aa4e-4bd513b4c448 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:03.520787 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-405097d8-edc8-427c-aa4e-4bd513b4c448 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:03.525424 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-405097d8-edc8-427c-aa4e-4bd513b4c448 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:03.562899 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-405097d8-edc8-427c-aa4e-4bd513b4c448 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=719e63a936c84376b1f756f55b7d6c8a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2219794 Nov 12 15:04:03.563758 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-405097d8-edc8-427c-aa4e-4bd513b4c448 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cfa0343e-98a7-4796-bd14-a55c444d776b,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:03.565576 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34910) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:03.612239 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-26e3acaa-e2e9-467d-932d-9756fc6f9518 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:03.633024 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-26e3acaa-e2e9-467d-932d-9756fc6f9518 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:03.681613 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-26e3acaa-e2e9-467d-932d-9756fc6f9518 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:03.685120 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-26e3acaa-e2e9-467d-932d-9756fc6f9518 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:03.686513 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-26e3acaa-e2e9-467d-932d-9756fc6f9518 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/cfa0343e-98a7-4796-bd14-a55c444d776b HTTP/1.1" status: 204 len: 168 time: 0.1197524 Nov 12 15:04:03.696989 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e3acaa-e2e9-467d-932d-9756fc6f9518 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cfa0343e-98a7-4796-bd14-a55c444d776b,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:03.957702 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 34916) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:03.971048 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-51661152-a1ae-407b-aa10-75925d517df0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:04.048906 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-51661152-a1ae-407b-aa10-75925d517df0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:04.053071 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-51661152-a1ae-407b-aa10-75925d517df0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:04.092151 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-51661152-a1ae-407b-aa10-75925d517df0 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a1a87f44825349da9de7695263ea0e77&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1332610 Nov 12 15:04:04.093000 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51661152-a1ae-407b-aa10-75925d517df0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2e771ed-354b-4437-9d1e-d76ec8a64404,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:04.094807 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 34918) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:04.142082 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-101014ef-cee9-467b-ba53-684f2c9e86c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:04.161985 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-101014ef-cee9-467b-ba53-684f2c9e86c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:04.206681 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-101014ef-cee9-467b-ba53-684f2c9e86c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:04.209257 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-101014ef-cee9-467b-ba53-684f2c9e86c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:04.210380 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-101014ef-cee9-467b-ba53-684f2c9e86c3 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/b2e771ed-354b-4437-9d1e-d76ec8a64404 HTTP/1.1" status: 204 len: 168 time: 0.1143994 Nov 12 15:04:04.217959 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-101014ef-cee9-467b-ba53-684f2c9e86c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2e771ed-354b-4437-9d1e-d76ec8a64404,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:04.997163 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.138378 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35014) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:09.244100 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7398df64-356c-45dd-a6b7-812f7b68e6ae admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.324864 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7398df64-356c-45dd-a6b7-812f7b68e6ae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.330415 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-7398df64-356c-45dd-a6b7-812f7b68e6ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.371323 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7398df64-356c-45dd-a6b7-812f7b68e6ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b0793e3-86ff-4809-b0e3-c60ede743914,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:09.376742 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-7398df64-356c-45dd-a6b7-812f7b68e6ae admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=5ddf4446fdd849ccb5620fb54d6b2766&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2373044 Nov 12 15:04:09.379429 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35018) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:09.438494 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ba7914e1-a3e8-44b9-aa94-920a144b068b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.460389 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ba7914e1-a3e8-44b9-aa94-920a144b068b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.506533 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ba7914e1-a3e8-44b9-aa94-920a144b068b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.509389 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ba7914e1-a3e8-44b9-aa94-920a144b068b admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.510807 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-ba7914e1-a3e8-44b9-aa94-920a144b068b admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1b0793e3-86ff-4809-b0e3-c60ede743914 HTTP/1.1" status: 204 len: 168 time: 0.1303973 Nov 12 15:04:09.521688 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba7914e1-a3e8-44b9-aa94-920a144b068b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b0793e3-86ff-4809-b0e3-c60ede743914,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:09.750240 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-390cb06f-c64e-4ee7-aaee-43f2e6804f51 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0477107 Nov 12 15:04:09.799778 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35024) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:09.813033 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f6ead44c-8033-4895-85fe-a4f2df369d2a admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.838547 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-86647dc5-d328-4f68-8b9e-085b2a35e310 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:04:09.840177 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-86647dc5-d328-4f68-8b9e-085b2a35e310 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=49070bd2a8b542b3801c73a224b4bba5&device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1098 time: 0.0415709 Nov 12 15:04:09.896013 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f6ead44c-8033-4895-85fe-a4f2df369d2a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.899988 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f6ead44c-8033-4895-85fe-a4f2df369d2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:09.940638 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f6ead44c-8033-4895-85fe-a4f2df369d2a admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=f95ac6b400854e2a978214f3683a1a8b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1373625 Nov 12 15:04:09.940638 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6ead44c-8033-4895-85fe-a4f2df369d2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a65af43f-9ed9-480d-be42-3dc78b363775,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:09.941838 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35026) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:09.958348 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-1746d8ab-f1a6-46dd-9fca-90dc76bc7c84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:04:09.959807 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-1746d8ab-f1a6-46dd-9fca-90dc76bc7c84 service neutron] 10.222.0.86 "GET /v2.0/networks?id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b HTTP/1.1" status: 200 len: 910 time: 0.0968766 Nov 12 15:04:09.990256 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fab137f6-271d-4ae9-a7c3-e1a27c3d3755 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:10.011916 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fab137f6-271d-4ae9-a7c3-e1a27c3d3755 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:10.028370 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-e3172d4f-1503-4daf-8ab0-5748d911ffad service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ce38b191-8562-4891-b8f8-a8b58d423729 HTTP/1.1" status: 200 len: 1001 time: 0.0591412 Nov 12 15:04:10.064815 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fab137f6-271d-4ae9-a7c3-e1a27c3d3755 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:10.067332 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fab137f6-271d-4ae9-a7c3-e1a27c3d3755 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:10.068535 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-fab137f6-271d-4ae9-a7c3-e1a27c3d3755 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/a65af43f-9ed9-480d-be42-3dc78b363775 HTTP/1.1" status: 204 len: 168 time: 0.1257131 Nov 12 15:04:10.077246 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fab137f6-271d-4ae9-a7c3-e1a27c3d3755 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a65af43f-9ed9-480d-be42-3dc78b363775,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:10.083237 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-8f749bdd-512f-48aa-8e41-63752179e9c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:04:10.084756 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-8f749bdd-512f-48aa-8e41-63752179e9c8 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=0d076ecb-e243-4855-ace2-0ad087866ab5 HTTP/1.1" status: 200 len: 848 time: 0.0490432 Nov 12 15:04:10.138590 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-686a47ac-dcb4-47d6-81b1-72528584c566 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:04:10.140087 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-686a47ac-dcb4-47d6-81b1-72528584c566 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0452046 Nov 12 15:04:10.234973 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-8d8a0824-a096-4b1b-92ec-6c88ccb8aa0a service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868669 Nov 12 15:04:10.334666 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9e0bf5c6-c04c-46ac-82b1-400d4dd6f353 req-8466d92a-ecaf-4e60-a852-764c082e756f service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917284 Nov 12 15:04:11.699536 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35076) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:11.811984 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-d286acb5-551b-4e52-a594-8b6eef51ff95 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:11.891748 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-d286acb5-551b-4e52-a594-8b6eef51ff95 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:11.895969 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-d286acb5-551b-4e52-a594-8b6eef51ff95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:11.934834 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-d286acb5-551b-4e52-a594-8b6eef51ff95 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=29157eb8254046748efa3792f3dcb10d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2341449 Nov 12 15:04:11.935673 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d286acb5-551b-4e52-a594-8b6eef51ff95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1066095-55e6-490c-90a1-2c92026d2b80,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:11.937490 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35080) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:11.987292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-91a0ece8-e138-4cd6-975a-c7b8660a60e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.008735 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-91a0ece8-e138-4cd6-975a-c7b8660a60e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.056902 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-91a0ece8-e138-4cd6-975a-c7b8660a60e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.059815 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-91a0ece8-e138-4cd6-975a-c7b8660a60e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.061126 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-91a0ece8-e138-4cd6-975a-c7b8660a60e3 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/d1066095-55e6-490c-90a1-2c92026d2b80 HTTP/1.1" status: 204 len: 168 time: 0.1226420 Nov 12 15:04:12.069364 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91a0ece8-e138-4cd6-975a-c7b8660a60e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1066095-55e6-490c-90a1-2c92026d2b80,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:12.326698 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35086) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:12.340162 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-129a1fbe-678d-4e6c-ad96-949342cdf76d admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.417978 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-129a1fbe-678d-4e6c-ad96-949342cdf76d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.421994 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-129a1fbe-678d-4e6c-ad96-949342cdf76d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.455965 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-129a1fbe-678d-4e6c-ad96-949342cdf76d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=21a7f7f2-23cb-4695-bc36-8758fa345ed1,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:12.463796 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-129a1fbe-678d-4e6c-ad96-949342cdf76d admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=fa658bd3b3a3481a962ab41d8eec0b17&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1360712 Nov 12 15:04:12.466476 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35088) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:12.519825 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4ea57cdc-2233-4367-96c1-e11d4551703d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.540614 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4ea57cdc-2233-4367-96c1-e11d4551703d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.586062 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4ea57cdc-2233-4367-96c1-e11d4551703d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.588777 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-4ea57cdc-2233-4367-96c1-e11d4551703d admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:12.589925 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-4ea57cdc-2233-4367-96c1-e11d4551703d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/21a7f7f2-23cb-4695-bc36-8758fa345ed1 HTTP/1.1" status: 204 len: 168 time: 0.1226699 Nov 12 15:04:12.597721 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ea57cdc-2233-4367-96c1-e11d4551703d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=21a7f7f2-23cb-4695-bc36-8758fa345ed1,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:14.304372 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35142) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:14.406921 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f07eee76-d408-4813-b5f9-4430a922ab49 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:14.490152 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f07eee76-d408-4813-b5f9-4430a922ab49 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:14.493992 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f07eee76-d408-4813-b5f9-4430a922ab49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:14.534366 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f07eee76-d408-4813-b5f9-4430a922ab49 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a5d77e2df92945a5857bae4b43a72118&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2289088 Nov 12 15:04:14.535232 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07eee76-d408-4813-b5f9-4430a922ab49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec60bcc2-1347-446c-b2ee-a3f55cd5802a,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:14.537652 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35146) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:14.584912 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07df3e59-9ba7-4a0c-bbc8-cc96ccff1139 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:14.605891 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07df3e59-9ba7-4a0c-bbc8-cc96ccff1139 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:14.656092 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07df3e59-9ba7-4a0c-bbc8-cc96ccff1139 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:14.658692 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-07df3e59-9ba7-4a0c-bbc8-cc96ccff1139 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:14.659885 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-07df3e59-9ba7-4a0c-bbc8-cc96ccff1139 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/ec60bcc2-1347-446c-b2ee-a3f55cd5802a HTTP/1.1" status: 204 len: 168 time: 0.1211751 Nov 12 15:04:14.667641 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07df3e59-9ba7-4a0c-bbc8-cc96ccff1139 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec60bcc2-1347-446c-b2ee-a3f55cd5802a,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:14.939402 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35152) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:14.953815 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-381e5d75-1aa7-4ec1-8cd1-9a8e8172fb40 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:15.031227 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-381e5d75-1aa7-4ec1-8cd1-9a8e8172fb40 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:15.034569 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-381e5d75-1aa7-4ec1-8cd1-9a8e8172fb40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:15.073375 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-381e5d75-1aa7-4ec1-8cd1-9a8e8172fb40 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=c9ef22280e3e4da7928266cd346ef5e9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1326609 Nov 12 15:04:15.074346 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-381e5d75-1aa7-4ec1-8cd1-9a8e8172fb40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=156ce7ed-60db-405b-9187-d9bd034200b4,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:15.077413 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35154) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:15.127444 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f1cf4e9b-59c4-41aa-ada0-8d30a6b4bf15 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:15.148672 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f1cf4e9b-59c4-41aa-ada0-8d30a6b4bf15 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:15.195818 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f1cf4e9b-59c4-41aa-ada0-8d30a6b4bf15 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:15.198405 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-f1cf4e9b-59c4-41aa-ada0-8d30a6b4bf15 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:15.199539 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-f1cf4e9b-59c4-41aa-ada0-8d30a6b4bf15 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/156ce7ed-60db-405b-9187-d9bd034200b4 HTTP/1.1" status: 204 len: 168 time: 0.1211283 Nov 12 15:04:15.207974 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1cf4e9b-59c4-41aa-ada0-8d30a6b4bf15 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=156ce7ed-60db-405b-9187-d9bd034200b4,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:16.227343 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35184) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:16.343230 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:16.417675 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:16.422298 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:16.458455 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a78c742-4d6c-4aae-9b15-10b577b2d163,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:16.463037 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=9ac2df337d9e4207a6c74c88346ee69b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2346897 Nov 12 15:04:16.465914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35188) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:16.467738 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.468071 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.468437 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.468773 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.469102 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.469430 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.469758 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.470082 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.470406 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.470742 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.471047 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.471363 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05fd47ff-4baa-4f4d-ba86-54179cff1d08 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:04:16.515014 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4a6c31f2-a04e-4c25-9908-3a3137c3ce33 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:16.535556 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4a6c31f2-a04e-4c25-9908-3a3137c3ce33 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:16.580922 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4a6c31f2-a04e-4c25-9908-3a3137c3ce33 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:16.583509 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-4a6c31f2-a04e-4c25-9908-3a3137c3ce33 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:16.584660 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-4a6c31f2-a04e-4c25-9908-3a3137c3ce33 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/3a78c742-4d6c-4aae-9b15-10b577b2d163 HTTP/1.1" status: 204 len: 168 time: 0.1177843 Nov 12 15:04:16.592120 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a6c31f2-a04e-4c25-9908-3a3137c3ce33 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a78c742-4d6c-4aae-9b15-10b577b2d163,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:20.163676 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35238) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:20.272131 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2c75d076-7d63-4420-a488-d7954e245647 admin admin] Publish callbacks [] for security_group, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:20.355810 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2c75d076-7d63-4420-a488-d7954e245647 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:20.359991 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-2c75d076-7d63-4420-a488-d7954e245647 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:20.399461 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-2c75d076-7d63-4420-a488-d7954e245647 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=affd51260ce742cca5ae600d6205edf8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2346013 Nov 12 15:04:20.400384 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c75d076-7d63-4420-a488-d7954e245647 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=249593fe-9c1c-4811-8d24-8b0b1e02cd8e,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:20.402160 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35242) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:04:20.457175 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-271f453d-aa41-4a34-9348-955d64b96f12 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:20.479769 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-271f453d-aa41-4a34-9348-955d64b96f12 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:20.528576 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-271f453d-aa41-4a34-9348-955d64b96f12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:20.531187 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-271f453d-aa41-4a34-9348-955d64b96f12 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:20.532517 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-271f453d-aa41-4a34-9348-955d64b96f12 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/249593fe-9c1c-4811-8d24-8b0b1e02cd8e HTTP/1.1" status: 204 len: 168 time: 0.1290922 Nov 12 15:04:20.540606 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-271f453d-aa41-4a34-9348-955d64b96f12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=249593fe-9c1c-4811-8d24-8b0b1e02cd8e,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:04:22.101131 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c98fd01e-4542-45be-b1b7-49ff3a3e9879 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:24.543895 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-dc51ffc7-9c14-493e-91f9-66e85ffbe491 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:25.558474 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:26.968774 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:27.927572 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:34.992629 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:35.336313 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:04:52.102803 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6b14821b-bfcd-4aea-8331-1be81fa4031c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:54.545322 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-10ecbec8-4dc1-413b-8d1a-27c6853523f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:55.561097 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:56.971448 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:04:57.928885 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:04.994275 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:08.818219 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35254) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:08.971414 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Deleting port 63aaba54-f83c-4d4c-bdce-92834993b9b4 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:08.972225 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:09.046750 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:09.047064 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:09.059003 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Calling delete_port for 63aaba54-f83c-4d4c-bdce-92834993b9b4 owned by network:floatingip {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:09.229289 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:09.254755 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event deleted for resources: {'Port': ['ID=63aaba54-f83c-4d4c-bdce-92834993b9b4,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:09.266509 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.266859 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.267204 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.267537 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.267954 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.268224 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.269132 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.269459 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.269785 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.270108 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.270430 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.270766 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:09.324559 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for floatingip, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:09.324888 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Floating IP 62085c6e-32e7-46ea-a10e-bdd797e42644 disassociated (deleted). External IP: 172.27.3.230, port: ce38b191-8562-4891-b8f8-a8b58d423729. Nov 12 15:05:09.796865 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-6f9c953a-f980-428a-88e2-f7b0c3f19c3f service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0817642 Nov 12 15:05:09.820158 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:05:09.910845 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-f483c468-36eb-4530-9b9f-c07ff791684e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:09.912460 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-f483c468-36eb-4530-9b9f-c07ff791684e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 1098 time: 0.0889275 Nov 12 15:05:10.016772 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:05:10.024208 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:10.027553 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] Sync routers for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:05:10.040698 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:05:10.041403 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:04:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:10.068593 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-de5c34d7-383a-4ba5-ae46-0d0caaf3e0c6 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "DELETE /v2.0/floatingips/62085c6e-32e7-46ea-a10e-bdd797e42644 HTTP/1.1" status: 204 len: 168 time: 1.2492893 Nov 12 15:05:10.070773 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:05:10.072975 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb638f2d-d156-4f51-9172-b05428ab8086" -d '{"events": [{"name": "network-changed", "server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:05:10.078633 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-9b8c8f8c-83ab-4d48-ba8c-0ef60b66209b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:10.079628 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-9b8c8f8c-83ab-4d48-ba8c-0ef60b66209b service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.1367774 Nov 12 15:05:10.128824 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:05:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d46795cf-41b0-4973-a0ab-31403d0419c3 x-openstack-request-id: req-d46795cf-41b0-4973-a0ab-31403d0419c3 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:05:10.129089 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:05:10.129351 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-d46795cf-41b0-4973-a0ab-31403d0419c3 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:05:10.129744 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'status': 'completed', 'code': 200} Nov 12 15:05:10.153211 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:05:10.178707 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-e391c9d3-74fb-48b8-b419-f0261f5720c4 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=3d15c733-cbae-41dd-b648-31abd3f8680c HTTP/1.1" status: 200 len: 1001 time: 0.0894072 Nov 12 15:05:10.222146 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-a6f155b4-6f67-434d-86aa-e140d91065f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:10.223641 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-a6f155b4-6f67-434d-86aa-e140d91065f0 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=49070bd2a8b542b3801c73a224b4bba5&device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 1098 time: 0.0786541 Nov 12 15:05:10.267245 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-df351742-df44-4a84-9c44-b1862b634716 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:10.269286 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-df351742-df44-4a84-9c44-b1862b634716 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0806720 Nov 12 15:05:10.361057 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-7d456542-401f-43c8-a5a2-9cd4608cb6e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:10.362895 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-7d456542-401f-43c8-a5a2-9cd4608cb6e6 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0630696 Nov 12 15:05:10.368195 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-a01c0945-658d-43fa-b700-372f3c9cf223 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:10.370184 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-a01c0945-658d-43fa-b700-372f3c9cf223 service neutron] 10.222.0.86 "GET /v2.0/networks?id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b HTTP/1.1" status: 200 len: 910 time: 0.1360185 Nov 12 15:05:10.375467 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:29Z', 'revision_number': 5, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:10.404284 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] Checking router: 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:05:10.413416 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:05:10.414028 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:04:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:10.435185 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-1f36d9ee-86fb-4689-9733-9342465ac68a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ce38b191-8562-4891-b8f8-a8b58d423729 HTTP/1.1" status: 200 len: 217 time: 0.0551763 Nov 12 15:05:10.489241 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f406849-581e-42e7-b555-b6a8fcf14e57 req-eff42a98-8ba2-49ff-a51e-9b79fb8ea5c8 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:10.493293 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4f406849-581e-42e7-b555-b6a8fcf14e57 req-eff42a98-8ba2-49ff-a51e-9b79fb8ea5c8 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.2276745 Nov 12 15:05:10.526715 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:05:10.526996 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-b0ed15b0-d1d9-4f5b-99c4-c053a2d3e7fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:10.528491 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-b0ed15b0-d1d9-4f5b-99c4-c053a2d3e7fd service neutron] 10.222.0.86 "GET /v2.0/subnets?id=0d076ecb-e243-4855-ace2-0ad087866ab5 HTTP/1.1" status: 200 len: 848 time: 0.0659924 Nov 12 15:05:10.549185 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-44ce9a27-a9e0-4870-8fb7-eb5c322db484 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1780748 Nov 12 15:05:10.551698 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4f406849-581e-42e7-b555-b6a8fcf14e57 req-7cbe6b86-1bb8-48bc-9ddf-992d65c9bf9d tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0521483 Nov 12 15:05:10.639944 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-2c70b42e-d54f-4019-9cbb-ef45ae6b9d88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:10.641485 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-2c70b42e-d54f-4019-9cbb-ef45ae6b9d88 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1031902 Nov 12 15:05:10.684258 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bf02d3f-f1cc-4f94-a855-fd643662f9d3 req-c041ed3b-73de-4ceb-a82c-dad5f840d629 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1197805 Nov 12 15:05:10.765083 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-badf59a9-3591-4589-80fa-796fc5aa617d service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1111052 Nov 12 15:05:10.767370 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:29Z', 'revision_number': 5, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:10.798703 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b123df2d-a582-41c5-b7ac-f021d734a02b None None] The sync data for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi is: [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:00:24Z', 'revision_number': 4, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': '41ed57ec-72c3-4a85-9fb7-dccd23c0a16c', 'name': '', 'network_id': 'ca05832f-5b12-4ac8-b78f-b968aa7e8f1b', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'mac_address': 'fa:16:3e:6e:62:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:23Z', 'updated_at': '2021-11-12T15:00:29Z', 'revision_number': 5, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'subnets': [{'id': '0d076ecb-e243-4855-ace2-0ad087866ab5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:05:10.870206 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-bb638f2d-d156-4f51-9172-b05428ab8086 req-afaeddda-19c4-4f4a-9a83-3eb4f2195c5d service neutron] 10.222.0.86 "GET /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0955532 Nov 12 15:05:11.034103 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5f46d33-35e2-4814-9f20-1661f36e101c None None] New status for floating IP 62085c6e-32e7-46ea-a10e-bdd797e42644: DOWN {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:05:11.724333 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b61e5a6-1439-4f88-8d49-876eb05bdbb9 req-def54b3f-98c4-43c2-9d82-396ad747206a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:11.725814 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1b61e5a6-1439-4f88-8d49-876eb05bdbb9 req-def54b3f-98c4-43c2-9d82-396ad747206a tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.1063678 Nov 12 15:05:11.778544 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-1b61e5a6-1439-4f88-8d49-876eb05bdbb9 req-6a6d7d8e-94a4-4dd9-b0f9-bbb284486e85 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/security-groups?id=708da2d1-4d8f-46ad-af5e-34eafadae301&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456455 Nov 12 15:05:12.070704 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-4b2cab57-69bc-4936-8a88-b2dca1ac3871 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:12.072263 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-4b2cab57-69bc-4936-8a88-b2dca1ac3871 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.86 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 945 time: 0.0502529 Nov 12 15:05:12.169426 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Deleting port ce38b191-8562-4891-b8f8-a8b58d423729 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:12.169767 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:12.259106 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] For port ce38b191-8562-4891-b8f8-a8b58d423729, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=ce38b191-8562-4891-b8f8-a8b58d423729,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:12.259461 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:12.273248 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Calling delete_port for ce38b191-8562-4891-b8f8-a8b58d423729 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:12.338917 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:05:12.405740 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:12.435287 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event deleted for resources: {'Port': ['ID=ce38b191-8562-4891-b8f8-a8b58d423729,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:12.479480 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] No DVR routers for this DVR port ce38b191-8562-4891-b8f8-a8b58d423729 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:05:12.482004 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:12.485403 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2c71c9e3-b184-4b25-aec8-fd24439a8a30 req-52c8822d-08a9-4d67-bffc-300b99e430c4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.86 "DELETE /v2.0/ports/ce38b191-8562-4891-b8f8-a8b58d423729 HTTP/1.1" status: 204 len: 173 time: 0.4065793 Nov 12 15:05:12.485843 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'name': 'network-vif-deleted', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:05:12.488656 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c3b6a9c-4140-43b3-abee-77985ba1322a" -d '{"events": [{"server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "name": "network-vif-deleted", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:05:12.666460 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:05:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56fd4d82-a09f-4153-b921-4af20ee6ce4a x-openstack-request-id: req-56fd4d82-a09f-4153-b921-4af20ee6ce4a {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:05:12.666747 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6d46ecda-d42d-4910-8d8e-306a6de98e67", "name": "network-vif-deleted", "tag": "ce38b191-8562-4891-b8f8-a8b58d423729", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:05:12.666993 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-56fd4d82-a09f-4153-b921-4af20ee6ce4a {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:05:12.667386 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6d46ecda-d42d-4910-8d8e-306a6de98e67', 'name': 'network-vif-deleted', 'tag': 'ce38b191-8562-4891-b8f8-a8b58d423729', 'status': 'completed', 'code': 200} Nov 12 15:05:12.889346 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5ae0d6ce-8af6-4d1d-bf10-d73d97078e03 req-68d4770e-9499-4e70-8de4-ec4844fc44a3 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "GET /v2.0/ports?device_id=6d46ecda-d42d-4910-8d8e-306a6de98e67 HTTP/1.1" status: 200 len: 210 time: 0.0317445 Nov 12 15:05:13.951435 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35282) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:13.987237 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ce38b191-8562-4891-b8f8-a8b58d423729 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:05:14.004825 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5f40a0ea-d1c3-4d10-97b9-14d075fe3df4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:14.006448 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: ce38b191-8562-4891-b8f8-a8b58d423729 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:05:14.006796 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device ce38b191-8562-4891-b8f8-a8b58d423729 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:05:14.029993 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5f40a0ea-d1c3-4d10-97b9-14d075fe3df4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:14.088287 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5f40a0ea-d1c3-4d10-97b9-14d075fe3df4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:14.090942 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-5f40a0ea-d1c3-4d10-97b9-14d075fe3df4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:14.092100 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-5f40a0ea-d1c3-4d10-97b9-14d075fe3df4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] 10.222.0.61 "DELETE /v2.0/security-groups/708da2d1-4d8f-46ad-af5e-34eafadae301 HTTP/1.1" status: 204 len: 168 time: 0.1429214 Nov 12 15:05:14.102493 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f40a0ea-d1c3-4d10-97b9-14d075fe3df4 tempest-TestShelveInstance-2014629385 tempest-TestShelveInstance-2014629385-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=708da2d1-4d8f-46ad-af5e-34eafadae301,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:14.132444 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35286) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:14.478532 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1754847'] for router_interface, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:14.719609 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Deleting port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:14.719943 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:14.795426 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] For port 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=41ed57ec-72c3-4a85-9fb7-dccd23c0a16c,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:14.795678 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:14.808494 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Calling delete_port for 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c owned by network:router_interface {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:14.989967 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:15.017675 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Pushing event deleted for resources: {'Port': ['ID=41ed57ec-72c3-4a85-9fb7-dccd23c0a16c,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:15.183444 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611175', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1753199'] for router_interface, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:15.650177 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:05:15.755269 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:05:15.760593 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-bcb7b2fa-0dd7-4d29-af4d-24a23319e9a5 admin admin] 10.222.0.61 "PUT /v2.0/routers/53ca2130-36ca-4c05-9d6e-aa26fcf314f9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6268256 Nov 12 15:05:15.763365 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35288) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:15.765979 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] Sync routers for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:05:15.776900 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:05:15.777522 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:04:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:15.866958 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks [] for router, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:15.881364 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:05:15.968088 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.025637 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Deleting port d65653f6-11ec-4231-a8a2-0a1f72ba1870 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:16.026388 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.060974 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86'}], 'enable_snat': True}, 'gw_port_id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:05:14Z', 'revision_number': 5, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port': {'id': 'd65653f6-11ec-4231-a8a2-0a1f72ba1870', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:90:b4:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 498, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:21Z', 'updated_at': '2021-11-12T15:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:16.089502 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] Checking router: 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:05:16.098215 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] Routers {'53ca2130-36ca-4c05-9d6e-aa26fcf314f9'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:05:16.098805 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:04:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:16.105021 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] For port d65653f6-11ec-4231-a8a2-0a1f72ba1870, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=d65653f6-11ec-4231-a8a2-0a1f72ba1870,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:16.105388 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.118706 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Calling delete_port for d65653f6-11ec-4231-a8a2-0a1f72ba1870 owned by network:router_gateway {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:16.290698 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.307445 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] Set router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 gateway port host: None {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:05:16.317363 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Pushing event deleted for resources: {'Port': ['ID=d65653f6-11ec-4231-a8a2-0a1f72ba1870,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:16.358367 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:05:15Z', 'revision_number': 6, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port_host': None}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:16.383358 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1760149'] for router_gateway, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.387770 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e6d1dae-ac20-4734-95d4-408cdc4445e5 None None] The sync data for ids ['53ca2130-36ca-4c05-9d6e-aa26fcf314f9'] in dv-cinder-776422-5-iscsi is: [{'id': '53ca2130-36ca-4c05-9d6e-aa26fcf314f9', 'name': 'tempest-TestShelveInstance-1743828636-router', 'tenant_id': '49070bd2a8b542b3801c73a224b4bba5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:20Z', 'updated_at': '2021-11-12T15:05:15Z', 'revision_number': 6, 'project_id': '49070bd2a8b542b3801c73a224b4bba5', 'gw_port_host': None}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:05:16.476310 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1755136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-43439'] for router, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.478437 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.521377 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1755257'] for router, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.521905 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Fanout notify agent at l3_agent the message router_deleted on router 53ca2130-36ca-4c05-9d6e-aa26fcf314f9 {{(pid=101618) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 12 15:05:16.526218 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.527358 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-1bfe595b-789f-487c-9ec2-0d35e41797ce admin admin] 10.222.0.61 "DELETE /v2.0/routers/53ca2130-36ca-4c05-9d6e-aa26fcf314f9 HTTP/1.1" status: 204 len: 168 time: 0.7630761 Nov 12 15:05:16.529970 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35290) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:16.574944 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_v2 [None req-b7d62d9c-0cbd-4f9d-8e1b-32275a29ec52 admin admin] Deleting subnet 0d076ecb-e243-4855-ace2-0ad087866ab5 {{(pid=101618) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:05:16.578103 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b7d62d9c-0cbd-4f9d-8e1b-32275a29ec52 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.619152 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b7d62d9c-0cbd-4f9d-8e1b-32275a29ec52 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4364798'] for subnet, precommit_delete_associations {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.729862 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b7d62d9c-0cbd-4f9d-8e1b-32275a29ec52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.789687 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b7d62d9c-0cbd-4f9d-8e1b-32275a29ec52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5822906', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5528368'] for subnet, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.813988 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7d62d9c-0cbd-4f9d-8e1b-32275a29ec52 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0d076ecb-e243-4855-ace2-0ad087866ab5,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:16.820138 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-b7d62d9c-0cbd-4f9d-8e1b-32275a29ec52 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.823378 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-b7d62d9c-0cbd-4f9d-8e1b-32275a29ec52 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/0d076ecb-e243-4855-ace2-0ad087866ab5 HTTP/1.1" status: 204 len: 168 time: 0.2924414 Nov 12 15:05:16.825890 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35292) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:16.827863 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36e3f3b2-425c-464c-9577-999a978d68c2 None None] Network ca05832f-5b12-4ac8-b78f-b968aa7e8f1b requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:05:16.892589 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:16.948710 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Deleting port 0919ba46-31b7-4b8e-9509-d367d4bbabdb {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:16.949040 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:17.011272 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] For port 0919ba46-31b7-4b8e-9509-d367d4bbabdb, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=0919ba46-31b7-4b8e-9509-d367d4bbabdb,segment=NetworkSegment(01124735-d9c7-40e8-a61c-2a8529779c8d),segment_id=01124735-d9c7-40e8-a61c-2a8529779c8d)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:17.011624 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:17.024561 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Calling delete_port for 0919ba46-31b7-4b8e-9509-d367d4bbabdb owned by network:dhcp {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:17.102590 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:17.128907 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Pushing event deleted for resources: {'Port': ['ID=0919ba46-31b7-4b8e-9509-d367d4bbabdb,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:17.132471 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] No DVR routers for this DVR port 0919ba46-31b7-4b8e-9509-d367d4bbabdb on host dv-cinder-776422-5-iscsi {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:05:17.167756 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-437e5285-1478-4b78-b9a8-82ac32ec5588 None None] DHCP port deletion for ca05832f-5b12-4ac8-b78f-b968aa7e8f1b request from dv-cinder-776422-5-iscsi {{(pid=101619) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 12 15:05:17.209993 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:17.230291 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ca05832f-5b12-4ac8-b78f-b968aa7e8f1b']}} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:17.233031 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0919ba46-31b7-4b8e-9509-d367d4bbabdb no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:05:17.240682 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '01124735-d9c7-40e8-a61c-2a8529779c8d') {'for_net_delete': True} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:17.240982 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '01124735-d9c7-40e8-a61c-2a8529779c8d') {} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:17.251504 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4359949'] for segment, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:17.255219 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 0919ba46-31b7-4b8e-9509-d367d4bbabdb {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:05:17.255563 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0919ba46-31b7-4b8e-9509-d367d4bbabdb not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:05:17.256159 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:05:17.268347 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:17.274664 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Releasing vlan 623 on physical network physnet1 to pool {{(pid=101618) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:05:17.275062 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5822932'] for segment, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:17.275743 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:05:17.276087 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 41ed57ec-72c3-4a85-9fb7-dccd23c0a16c not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:05:17.276521 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device d65653f6-11ec-4231-a8a2-0a1f72ba1870 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: Traceback (most recent call last): Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: timer() Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: cb(*args, **kw) Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: return func(*args, **kwargs) Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: self._notify() Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: self.callback(batched_events) Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: event.method(event) Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: return f(self, *a, **k) Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._get(url).json() Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: return self.request(url, 'GET', **kwargs) Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:05:17.276953 dv-cinder-776422-5-iscsi neutron-server[101618]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:05:17.299062 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: d65653f6-11ec-4231-a8a2-0a1f72ba1870 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:05:17.299407 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device d65653f6-11ec-4231-a8a2-0a1f72ba1870 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:05:17.331097 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:17.338903 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:17.342217 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] 10.222.0.61 "DELETE /v2.0/networks/ca05832f-5b12-4ac8-b78f-b968aa7e8f1b HTTP/1.1" status: 204 len: 168 time: 0.5154638 Nov 12 15:05:17.345239 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35294) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:17.353880 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8bc66d8-3d38-4415-b36d-1be612d40064 admin admin] Pushing event deleted for resources: {'Network': ['ID=ca05832f-5b12-4ac8-b78f-b968aa7e8f1b,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:17.922894 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1754847'] for router_interface, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:18.163034 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Deleting port cd8e036b-d217-4fa6-940d-9fc14004e5e6 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:18.163287 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:18.242487 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] For port cd8e036b-d217-4fa6-940d-9fc14004e5e6, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=cd8e036b-d217-4fa6-940d-9fc14004e5e6,segment=NetworkSegment(6b7c6928-b12a-4c48-a905-46863b8c9b31),segment_id=6b7c6928-b12a-4c48-a905-46863b8c9b31)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:18.242842 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:18.255130 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Calling delete_port for cd8e036b-d217-4fa6-940d-9fc14004e5e6 owned by network:router_interface {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:18.427910 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:18.457880 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Pushing event deleted for resources: {'Port': ['ID=cd8e036b-d217-4fa6-940d-9fc14004e5e6,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:18.478206 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.478553 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.478891 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.479244 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.479553 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.479883 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.480236 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.480563 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.480887 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.481204 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.481522 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.481842 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:18.624843 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611175', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1753199'] for router_interface, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:18.834303 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Router 91c37de3-bf30-4b11-bf97-996a0d1b7691 has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:05:18.944249 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:05:18.952083 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-5d4febfc-afe7-488a-9e46-458f15e28bbd admin admin] 10.222.0.61 "PUT /v2.0/routers/91c37de3-bf30-4b11-bf97-996a0d1b7691/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6056197 Nov 12 15:05:18.952666 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35296) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:18.956192 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] Sync routers for ids ['91c37de3-bf30-4b11-bf97-996a0d1b7691'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:05:18.967348 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] Routers {'91c37de3-bf30-4b11-bf97-996a0d1b7691'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:05:18.967978 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:04:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['91c37de3-bf30-4b11-bf97-996a0d1b7691'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:19.080261 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] Set router 91c37de3-bf30-4b11-bf97-996a0d1b7691 gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:05:19.165154 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks [] for router, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.261919 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214'}], 'enable_snat': True}, 'gw_port_id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:27Z', 'updated_at': '2021-11-12T15:05:18Z', 'revision_number': 5, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'gw_port': {'id': 'a37e6d6f-dfbc-497d-8a9f-aaacf5a15571', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:9f:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'device_owner': 'network:router_gateway', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:00:29Z', 'updated_at': '2021-11-12T15:00:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:19.268098 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.289302 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] Checking router: 91c37de3-bf30-4b11-bf97-996a0d1b7691 for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:05:19.298066 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] Routers {'91c37de3-bf30-4b11-bf97-996a0d1b7691'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:05:19.298714 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:04:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['91c37de3-bf30-4b11-bf97-996a0d1b7691'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:19.320051 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Deleting port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:19.320414 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.383148 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] Set router 91c37de3-bf30-4b11-bf97-996a0d1b7691 gateway port host: None {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:05:19.400570 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] For port a37e6d6f-dfbc-497d-8a9f-aaacf5a15571, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=a37e6d6f-dfbc-497d-8a9f-aaacf5a15571,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:19.400926 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.413680 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Calling delete_port for a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 owned by network:router_gateway {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:19.438154 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:27Z', 'updated_at': '2021-11-12T15:05:19Z', 'revision_number': 6, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'gw_port_host': None}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:19.464424 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-340b0f6e-b3f9-4040-80b5-6b82855f6bc1 None None] The sync data for ids ['91c37de3-bf30-4b11-bf97-996a0d1b7691'] in dv-cinder-776422-5-iscsi is: [{'id': '91c37de3-bf30-4b11-bf97-996a0d1b7691', 'name': 'tempest-TestShelveInstance-460788527-router', 'tenant_id': '09abb93cb62345ad88b8e5437b4be1a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:00:27Z', 'updated_at': '2021-11-12T15:05:19Z', 'revision_number': 6, 'project_id': '09abb93cb62345ad88b8e5437b4be1a2', 'gw_port_host': None}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:05:19.578699 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.608510 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Pushing event deleted for resources: {'Port': ['ID=a37e6d6f-dfbc-497d-8a9f-aaacf5a15571,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:19.664522 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1760149'] for router_gateway, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.757110 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1755136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-43439'] for router, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.759475 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.808750 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1755257'] for router, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.809699 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 91c37de3-bf30-4b11-bf97-996a0d1b7691 {{(pid=101618) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 12 15:05:19.815856 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] Publish callbacks [] for router, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.819316 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-bf4258b0-fad1-4ea5-a1cb-4ec43bf2b214 admin admin] 10.222.0.61 "DELETE /v2.0/routers/91c37de3-bf30-4b11-bf97-996a0d1b7691 HTTP/1.1" status: 204 len: 168 time: 0.8634019 Nov 12 15:05:19.819621 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35300) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:19.864901 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_v2 [None req-d3379d5b-1ffb-49a9-b6fc-d4808ab2286f admin admin] Deleting subnet 349dd9b2-ae54-4bac-b2af-edcb3af1d07c {{(pid=101618) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:05:19.868855 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d3379d5b-1ffb-49a9-b6fc-d4808ab2286f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.908466 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d3379d5b-1ffb-49a9-b6fc-d4808ab2286f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4364798'] for subnet, precommit_delete_associations {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:19.986615 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d3379d5b-1ffb-49a9-b6fc-d4808ab2286f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.048600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d3379d5b-1ffb-49a9-b6fc-d4808ab2286f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5822906', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5528368'] for subnet, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.074248 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3379d5b-1ffb-49a9-b6fc-d4808ab2286f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=349dd9b2-ae54-4bac-b2af-edcb3af1d07c,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:20.080154 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-d3379d5b-1ffb-49a9-b6fc-d4808ab2286f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for subnet, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.080874 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-d3379d5b-1ffb-49a9-b6fc-d4808ab2286f admin admin] 10.222.0.61 "DELETE /v2.0/subnets/349dd9b2-ae54-4bac-b2af-edcb3af1d07c HTTP/1.1" status: 204 len: 168 time: 0.2601593 Nov 12 15:05:20.083336 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35302) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:20.084180 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74e1a61b-2986-4a1e-b12f-c830678a7ec4 None None] Network 9ea4059b-341e-435e-a2c5-0eadc56bb957 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:05:20.154673 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.210791 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Deleting port f686347d-be75-499a-a04e-381fbb6bae13 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:20.211127 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.276821 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] DHCP port deletion for 9ea4059b-341e-435e-a2c5-0eadc56bb957 request from dv-cinder-776422-5-iscsi {{(pid=101619) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 12 15:05:20.289621 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] For port f686347d-be75-499a-a04e-381fbb6bae13, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=f686347d-be75-499a-a04e-381fbb6bae13,segment=NetworkSegment(6b7c6928-b12a-4c48-a905-46863b8c9b31),segment_id=6b7c6928-b12a-4c48-a905-46863b8c9b31)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:20.290036 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.307157 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Calling delete_port for f686347d-be75-499a-a04e-381fbb6bae13 owned by network:dhcp {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:20.325973 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Deleting port f686347d-be75-499a-a04e-381fbb6bae13 {{(pid=101619) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:20.326350 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.388558 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.394675 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] For port f686347d-be75-499a-a04e-381fbb6bae13, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=f686347d-be75-499a-a04e-381fbb6bae13,segment=NetworkSegment(6b7c6928-b12a-4c48-a905-46863b8c9b31),segment_id=6b7c6928-b12a-4c48-a905-46863b8c9b31)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:20.395080 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.408279 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Calling delete_port for f686347d-be75-499a-a04e-381fbb6bae13 owned by network:dhcp {{(pid=101619) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:20.414824 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Pushing event deleted for resources: {'Port': ['ID=f686347d-be75-499a-a04e-381fbb6bae13,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:20.421870 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] No DVR routers for this DVR port f686347d-be75-499a-a04e-381fbb6bae13 on host dv-cinder-776422-5-iscsi {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:05:20.490236 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.498600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.520097 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Pushing event deleted for resources: {'Port': ['ID=f686347d-be75-499a-a04e-381fbb6bae13,revision_number=None']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:20.520498 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9ea4059b-341e-435e-a2c5-0eadc56bb957']}} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:20.527826 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] No DVR routers for this DVR port f686347d-be75-499a-a04e-381fbb6bae13 on host dv-cinder-776422-5-iscsi {{(pid=101619) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:05:20.531254 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6b7c6928-b12a-4c48-a905-46863b8c9b31') {'for_net_delete': True} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:20.531489 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.531604 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.services.segments.db [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6b7c6928-b12a-4c48-a905-46863b8c9b31') {} {{(pid=101618) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:20.531833 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.532202 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.532531 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.532853 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.533359 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.533680 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.534542 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.534863 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.535176 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.535491 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.535818 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5bb63b0-dbb0-4f5e-87c2-58ad6eb6a95a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:05:20.546240 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4359949'] for segment, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.560387 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.566364 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Releasing vlan 643 on physical network physnet1 to pool {{(pid=101618) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:05:20.566764 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5822932'] for segment, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: Traceback (most recent call last): Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: timer() Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: cb(*args, **kw) Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: return func(*args, **kwargs) Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: self._notify() Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: self.callback(batched_events) Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: event.method(event) Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: return f(self, *a, **k) Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._get(url).json() Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: return self.request(url, 'GET', **kwargs) Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:05:20.568433 dv-cinder-776422-5-iscsi neutron-server[101618]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:05:20.623756 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.628623 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.631913 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] 10.222.0.61 "DELETE /v2.0/networks/9ea4059b-341e-435e-a2c5-0eadc56bb957 HTTP/1.1" status: 204 len: 168 time: 0.5476694 Nov 12 15:05:20.644178 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-659c29f9-a397-44cf-8ddf-89022c7fe072 admin admin] Pushing event deleted for resources: {'Network': ['ID=9ea4059b-341e-435e-a2c5-0eadc56bb957,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:20.743059 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35306) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:20.782754 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-c4dbd0c5-9df3-4947-bda5-8f44aa8fc95c admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=49070bd2a8b542b3801c73a224b4bba5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0384874 Nov 12 15:05:20.785372 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35308) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:20.833285 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8b52b6c-4909-4371-a077-4e597e806b61 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.853699 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8b52b6c-4909-4371-a077-4e597e806b61 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.899547 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8b52b6c-4909-4371-a077-4e597e806b61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.902188 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-a8b52b6c-4909-4371-a077-4e597e806b61 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:20.903337 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-a8b52b6c-4909-4371-a077-4e597e806b61 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/23a8b7cf-436d-48b1-96e4-f4effde97318 HTTP/1.1" status: 204 len: 168 time: 0.1170764 Nov 12 15:05:20.911671 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b52b6c-4909-4371-a077-4e597e806b61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23a8b7cf-436d-48b1-96e4-f4effde97318,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:20.976895 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device cd8e036b-d217-4fa6-940d-9fc14004e5e6 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:05:20.997370 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: cd8e036b-d217-4fa6-940d-9fc14004e5e6 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:05:20.997703 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device cd8e036b-d217-4fa6-940d-9fc14004e5e6 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:05:20.998113 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device f686347d-be75-499a-a04e-381fbb6bae13 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:05:21.019638 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: f686347d-be75-499a-a04e-381fbb6bae13 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:05:21.019984 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device f686347d-be75-499a-a04e-381fbb6bae13 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:05:21.020456 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:05:21.038963 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:05:21.039312 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device a37e6d6f-dfbc-497d-8a9f-aaacf5a15571 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:05:21.224591 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35314) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:21.263401 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-024b9ca6-4f16-447f-9eca-98c2d979b386 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=09abb93cb62345ad88b8e5437b4be1a2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0376644 Nov 12 15:05:21.265830 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35316) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:21.317021 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f3d5f0f4-749a-424f-82c4-14f983c3b284 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:21.337204 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f3d5f0f4-749a-424f-82c4-14f983c3b284 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:21.386070 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f3d5f0f4-749a-424f-82c4-14f983c3b284 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:21.389294 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f3d5f0f4-749a-424f-82c4-14f983c3b284 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:21.390959 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f3d5f0f4-749a-424f-82c4-14f983c3b284 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/7011e9a6-f233-47c6-881d-2853ed2e63be HTTP/1.1" status: 204 len: 168 time: 0.1237886 Nov 12 15:05:21.404292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3d5f0f4-749a-424f-82c4-14f983c3b284 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7011e9a6-f233-47c6-881d-2853ed2e63be,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:22.104774 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0e8241f9-5a43-4cae-bd1a-7970bfbcf1cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:24.547030 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e6a98961-e1ce-4ff0-8771-9ea7abc77716 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:25.565048 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:26.974537 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:27.933064 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:34.994679 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:39.355177 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37aa7051-f56f-48af-95a1-3006326c3dec req-5086e278-618e-4d04-b945-81b3d975d2dc tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:39.356670 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-37aa7051-f56f-48af-95a1-3006326c3dec req-5086e278-618e-4d04-b945-81b3d975d2dc tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 945 time: 0.0497377 Nov 12 15:05:39.408958 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-37aa7051-f56f-48af-95a1-3006326c3dec req-f1542931-a769-4325-82e8-1095386c6391 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0461118 Nov 12 15:05:40.533471 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-719960bc-6c44-4ca3-8205-445a10530ec4 req-5669daf5-a730-4d45-8d2d-fe5b44bb77da tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:40.535071 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-719960bc-6c44-4ca3-8205-445a10530ec4 req-5669daf5-a730-4d45-8d2d-fe5b44bb77da tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 945 time: 0.0523028 Nov 12 15:05:40.588239 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-719960bc-6c44-4ca3-8205-445a10530ec4 req-da2e5930-be8c-4e50-a82d-b4dfa1c878bf tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0463982 Nov 12 15:05:40.847106 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-ef7dbf4f-9fad-4be8-83d9-07dfb4bdff60 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:40.849217 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-ef7dbf4f-9fad-4be8-83d9-07dfb4bdff60 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 945 time: 0.0500350 Nov 12 15:05:40.951358 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Deleting port 3d15c733-cbae-41dd-b648-31abd3f8680c {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:05:40.951622 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:41.048921 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] For port 3d15c733-cbae-41dd-b648-31abd3f8680c, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=3d15c733-cbae-41dd-b648-31abd3f8680c,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:41.049283 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:41.259493 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:41.259762 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:41.260075 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Floating IP 2d4bc9b7-16dd-4477-b896-c37c245c4b3a disassociated. External IP: 172.27.3.148, port: 3d15c733-cbae-41dd-b648-31abd3f8680c. Nov 12 15:05:41.260460 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Calling delete_port for 3d15c733-cbae-41dd-b648-31abd3f8680c owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:05:41.396801 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:41.429050 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event deleted for resources: {'Port': ['ID=3d15c733-cbae-41dd-b648-31abd3f8680c,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:41.549948 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Router 8ec4de9e-dbf9-4aec-bff5-67be839601cd has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:05:41.906563 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-9f3752c9-49c3-46e8-9ce7-4799a0d800ea req-54b5ae30-2248-4a23-b0f2-9355c12d5a9f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=b71ba01f-bab4-486f-a7b2-99909d779c41 HTTP/1.1" status: 200 len: 210 time: 0.0357313 Nov 12 15:05:41.963229 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:05:41.975253 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] Sync routers for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:05:41.986569 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:05:41.987289 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:05:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:42.004492 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] No DVR routers for this DVR port 3d15c733-cbae-41dd-b648-31abd3f8680c on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:05:42.007034 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:42.010385 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4bc01c98-83f0-4ab4-83b4-ae165ba6c813 req-2f15c882-17b8-4e17-b40b-3bacad6612e7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "DELETE /v2.0/ports/3d15c733-cbae-41dd-b648-31abd3f8680c HTTP/1.1" status: 204 len: 173 time: 1.1532896 Nov 12 15:05:42.011093 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'name': 'network-vif-deleted', 'tag': '3d15c733-cbae-41dd-b648-31abd3f8680c'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:05:42.013472 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-33c82097-2c4d-4385-a4b2-16ee8e28d21a" -d '{"events": [{"server_uuid": "b71ba01f-bab4-486f-a7b2-99909d779c41", "name": "network-vif-deleted", "tag": "3d15c733-cbae-41dd-b648-31abd3f8680c"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:05:42.104670 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:05:42.252428 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:05:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-52034604-3e55-4cbe-a179-9f0094935a1d x-openstack-request-id: req-52034604-3e55-4cbe-a179-9f0094935a1d {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:05:42.252710 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b71ba01f-bab4-486f-a7b2-99909d779c41", "name": "network-vif-deleted", "tag": "3d15c733-cbae-41dd-b648-31abd3f8680c", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:05:42.253015 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-52034604-3e55-4cbe-a179-9f0094935a1d {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:05:42.253513 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b71ba01f-bab4-486f-a7b2-99909d779c41', 'name': 'network-vif-deleted', 'tag': '3d15c733-cbae-41dd-b648-31abd3f8680c', 'status': 'completed', 'code': 200} Nov 12 15:05:42.320650 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:42.347604 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] Checking router: 8ec4de9e-dbf9-4aec-bff5-67be839601cd for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:05:42.357011 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:05:42.357617 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:05:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:42.463697 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:05:42.669175 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:42.696948 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fddc301-9949-4f4d-a68d-19c1becf1206 None None] The sync data for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi is: [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:05:42.923701 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abfe8a7f-3b43-431f-ae5c-9aa8cf8a0e45 None None] New status for floating IP 2d4bc9b7-16dd-4477-b896-c37c245c4b3a: DOWN {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:05:43.171682 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-c751158c-df94-41e1-ae53-ba111b752c1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-61519927&fields=id&tenant_id=e0bd63a24fe9453c84dae6d5536c0df9 HTTP/1.1" status: 200 len: 267 time: 0.0475876 Nov 12 15:05:43.277072 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-601e5d9f-e240-4d77-8d99-bbe8b0e53990 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:43.278528 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-601e5d9f-e240-4d77-8d99-bbe8b0e53990 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 811 time: 0.0993230 Nov 12 15:05:43.293491 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-b8ce132e-2e52-4904-8637-13aa9639b755 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/quotas/e0bd63a24fe9453c84dae6d5536c0df9 HTTP/1.1" status: 200 len: 375 time: 0.0093663 Nov 12 15:05:43.348492 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-5ee189cd-46b4-4551-8ad2-27d95f2da709 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0492811 Nov 12 15:05:43.452562 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8c251ff1-3fd4-4f51-af5d-f46cede8e2bd service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101617) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 15:05:43.453616 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8c251ff1-3fd4-4f51-af5d-f46cede8e2bd service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0938017 Nov 12 15:05:43.546985 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-5463558b-11dd-4c27-9da0-3d2743beb9d3 service neutron] 10.222.0.61 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0871072 Nov 12 15:05:43.636515 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-79b3535c-856d-4dde-ad68-85894ead9e88 service neutron] 10.222.0.61 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825028 Nov 12 15:05:43.918838 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-83dec1d6-5e1d-4e76-887a-1ad2070de78c req-fc6a958c-b1f0-4590-9199-78f9f7f7b03e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 210 time: 0.0280101 Nov 12 15:05:44.074389 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 3d15c733-cbae-41dd-b648-31abd3f8680c no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:05:44.095538 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 3d15c733-cbae-41dd-b648-31abd3f8680c {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:05:44.095811 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 3d15c733-cbae-41dd-b648-31abd3f8680c not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:05:44.955656 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-28c45a3d-78f3-4136-99fa-296b6136f3de tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:44.957479 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-28c45a3d-78f3-4136-99fa-296b6136f3de tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 811 time: 0.1102853 Nov 12 15:05:45.022870 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-06e08741-0dd3-4e25-9401-e5a62de7f978 req-c26ea7c1-1ff7-4fe7-9587-fb9e2c34800a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 210 time: 0.0322471 Nov 12 15:05:45.026469 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-0a8dcf39-bd04-4501-9fd3-c531563ff54a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e0bd63a24fe9453c84dae6d5536c0df9 HTTP/1.1" status: 200 len: 378 time: 0.0587354 Nov 12 15:05:45.037203 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'port': {'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'admin_state_up': True, 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'security_groups': ['df9b544e-58f6-4924-9387-7a81ef202db0']}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:05:45.156485 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Made reservation on behalf of e0bd63a24fe9453c84dae6d5536c0df9 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:05:45.160094 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:45.291570 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Allocated IP 172.20.0.5 (370662ef-db75-4207-9a43-c725449d1d6d/40c8c5f2-e714-4a04-9300-6f56d57e5158/7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:05:45.441145 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:45.474906 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:45.516453 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Network 370662ef-db75-4207-9a43-c725449d1d6d is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:05:45.521630 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:05:45.525416 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:05:45.532256 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'Port': ['ID=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:45.583814 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:45.584455 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:45.602297 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8e083936-dd36-463b-9f6d-ac6694e2c99b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5696280 Nov 12 15:05:45.612483 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-311e6bb3-8f78-4682-b391-852ee8b5cc3d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=101618) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 12 15:05:45.614416 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-311e6bb3-8f78-4682-b391-852ee8b5cc3d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0063701 Nov 12 15:05:45.677946 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Request body: {'port': {'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:05:45.734949 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:45.825609 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-b97d1272-afd5-4f7e-a455-d4a95a8d4af1 None None] Provisioning complete for port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:05:45.826524 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b97d1272-afd5-4f7e-a455-d4a95a8d4af1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:45.863145 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-b97d1272-afd5-4f7e-a455-d4a95a8d4af1 None None] Port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:05:46.022231 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:05:46.030291 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:46.043465 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Transition to ACTIVE for port object 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:05:46.047437 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:46.113008 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Pushing event updated for resources: {'Port': ['ID=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:46.206140 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5485ba4-1b2d-43f7-ab71-334fdc13a48a req-9ef2cbef-f36d-47c5-be73-ef518aaa15ac tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:46.208317 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a5485ba4-1b2d-43f7-ab71-334fdc13a48a req-9ef2cbef-f36d-47c5-be73-ef518aaa15ac tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 943 time: 0.1074970 Nov 12 15:05:46.227476 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Attempting to bind port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:05:46.227808 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Attempting to bind port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:05:46.228157 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Attempting to bind port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 on network 370662ef-db75-4207-9a43-c725449d1d6d {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:05:46.241627 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 on network 370662ef-db75-4207-9a43-c725449d1d6d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:05:46.241950 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Attempting to bind port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 on network 370662ef-db75-4207-9a43-c725449d1d6d {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:05:46.255600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 5, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:05:46.255942 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Checking segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:05:46.256354 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Bound using segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:05:46.256794 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Bound port: 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:05:46.257143 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:46.291608 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-a5485ba4-1b2d-43f7-ab71-334fdc13a48a req-399c8bfa-422b-4d9b-9c6b-b54f285b309a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0755122 Nov 12 15:05:46.341812 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] For port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:05:46.344859 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] For port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:05:46.350050 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:46.392080 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:46.392723 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:46.394342 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] 10.222.0.86 "PUT /v2.0/ports/7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 HTTP/1.1" status: 200 len: 1093 time: 0.7716882 Nov 12 15:05:46.395275 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:05:46.397983 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43159a06-dda6-4fc8-9567-ffda0a3aaad3" -d '{"events": [{"name": "network-changed", "server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:05:46.426606 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52f2ee1a-ade1-4c74-ac6b-9045e8ff987a service neutron] Pushing event updated for resources: {'Port': ['ID=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:46.448332 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:05:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d31b8f12-3ff8-414d-9bdc-f3398af161b7 x-openstack-request-id: req-d31b8f12-3ff8-414d-9bdc-f3398af161b7 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:05:46.448622 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:05:46.448876 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-d31b8f12-3ff8-414d-9bdc-f3398af161b7 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:05:46.449270 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'status': 'completed', 'code': 200} Nov 12 15:05:46.486339 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-917fd2be-48fb-4c35-9300-a269c16ca4d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:46.487905 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-917fd2be-48fb-4c35-9300-a269c16ca4d8 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 1096 time: 0.0501595 Nov 12 15:05:46.532790 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-8d2c8801-8cbc-462a-8b9b-a4cef6441c33 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 HTTP/1.1" status: 200 len: 217 time: 0.0362275 Nov 12 15:05:46.585759 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-e8444691-2a33-41d8-bc96-5d6291095f6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:46.587210 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-e8444691-2a33-41d8-bc96-5d6291095f6c service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0452759 Nov 12 15:05:46.638398 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-e608003f-4ab0-4b7c-b5b2-a18b7583b2ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:46.639875 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-e608003f-4ab0-4b7c-b5b2-a18b7583b2ef service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0450366 Nov 12 15:05:46.728655 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-0c01efc5-7ef4-4100-a633-c51d425208ae service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802464 Nov 12 15:05:46.821822 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f246230d-608f-4465-a0ff-cbcad9c5a145 req-a689fb88-30a0-403b-bb4d-73eb7d7d2f7c service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0850840 Nov 12 15:05:46.911149 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-8c2173b5-5791-4699-9ae3-0fc55eff0d24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:46.912997 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-8c2173b5-5791-4699-9ae3-0fc55eff0d24 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 1096 time: 0.0414519 Nov 12 15:05:47.008941 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-0b46776f-c1a9-4cbd-bc3d-ffcc19c3e240 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:47.010409 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-0b46776f-c1a9-4cbd-bc3d-ffcc19c3e240 service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.0890267 Nov 12 15:05:47.055005 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-aacfe553-52a4-4017-9f9c-908a833e30e3 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 HTTP/1.1" status: 200 len: 217 time: 0.0348821 Nov 12 15:05:47.103302 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-d7c16e95-5cba-4aff-a2e1-8d99e7268080 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:47.104768 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-d7c16e95-5cba-4aff-a2e1-8d99e7268080 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0426178 Nov 12 15:05:47.152061 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-b07096b8-9414-4df5-b330-4b4289515773 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:47.153581 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-b07096b8-9414-4df5-b330-4b4289515773 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0414672 Nov 12 15:05:47.247093 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-ba8af6cf-4b58-4bde-a2d8-6f125312005d service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852735 Nov 12 15:05:47.340874 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-43159a06-dda6-4fc8-9567-ffda0a3aaad3 req-179684d6-171f-431f-b380-5c30fa019f3a service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856638 Nov 12 15:05:47.407040 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99249b09-756b-473f-bb36-9d902ae3d67d req-5f324979-4a47-4c93-a1e5-b1623949c45a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:47.408605 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-99249b09-756b-473f-bb36-9d902ae3d67d req-5f324979-4a47-4c93-a1e5-b1623949c45a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 943 time: 0.0502639 Nov 12 15:05:47.459549 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-99249b09-756b-473f-bb36-9d902ae3d67d req-5543ffea-1e30-4528-b39e-bb331789768b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0450506 Nov 12 15:05:48.576847 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d216665-c965-4998-a779-f3799607fa7d req-48000fa6-ae8e-4f92-b648-789245ed9f55 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:48.578448 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0d216665-c965-4998-a779-f3799607fa7d req-48000fa6-ae8e-4f92-b648-789245ed9f55 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 943 time: 0.0507474 Nov 12 15:05:48.631526 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-0d216665-c965-4998-a779-f3799607fa7d req-71f20ac3-9b86-486f-957a-6b1fe331c45f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0467682 Nov 12 15:05:49.339663 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:05:49.750442 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f280840-2468-4e74-b002-38f574b896b5 req-ac7adb97-a299-44e6-b833-a1658d94e19f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:49.751954 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3f280840-2468-4e74-b002-38f574b896b5 req-ac7adb97-a299-44e6-b833-a1658d94e19f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 943 time: 0.0504270 Nov 12 15:05:49.803846 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-3f280840-2468-4e74-b002-38f574b896b5 req-92929aee-71ba-4cd8-811f-e41ca51f49ce tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0451596 Nov 12 15:05:50.918059 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02356f55-eaed-470b-9e2d-b4051bc527c5 req-d9c56fa6-ac39-4a21-91d1-f01ce615f772 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:50.919872 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-02356f55-eaed-470b-9e2d-b4051bc527c5 req-d9c56fa6-ac39-4a21-91d1-f01ce615f772 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 943 time: 0.0491140 Nov 12 15:05:50.967863 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-02356f55-eaed-470b-9e2d-b4051bc527c5 req-cb963255-ea87-4e71-bd3b-d08122e8398f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0421340 Nov 12 15:05:52.084347 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb30e6b-51fb-4851-9ec9-cef39293761e req-1ecbbc70-07e6-4c9c-8932-0f2372bf37fc tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:52.085786 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fbb30e6b-51fb-4851-9ec9-cef39293761e req-1ecbbc70-07e6-4c9c-8932-0f2372bf37fc tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 943 time: 0.0519884 Nov 12 15:05:52.106564 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3276f8a9-6f76-4fe5-8c48-a532fef72e2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:52.139908 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-fbb30e6b-51fb-4851-9ec9-cef39293761e req-4271073d-15d5-42ee-98c5-95fa7f8002de tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0481656 Nov 12 15:05:53.255102 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a210eac-40b0-42c7-b364-3c3710a19d52 req-11f85e2c-c3be-4c13-92c5-39fa025b8813 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:53.256586 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4a210eac-40b0-42c7-b364-3c3710a19d52 req-11f85e2c-c3be-4c13-92c5-39fa025b8813 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 943 time: 0.0518868 Nov 12 15:05:53.304859 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-4a210eac-40b0-42c7-b364-3c3710a19d52 req-ee80fd8c-67c6-41eb-8e81-3a15602c604d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0422211 Nov 12 15:05:54.105219 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:05:54.199776 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:54.210960 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 605, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:05:54.246645 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:54.259623 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:05:54.278186 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:54.282102 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:54.332060 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:54.425641 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7248c79-387d-4afa-a637-92ac4930fcd7 req-269d1f0c-07e7-4c81-ad6c-31ed6fc3bf1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:54.427977 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e7248c79-387d-4afa-a637-92ac4930fcd7 req-269d1f0c-07e7-4c81-ad6c-31ed6fc3bf1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 944 time: 0.0519240 Nov 12 15:05:54.478900 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e7248c79-387d-4afa-a637-92ac4930fcd7 req-4b855f04-b990-4f6c-8073-112b044fc75b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0450225 Nov 12 15:05:54.498523 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:05:54.557519 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e86306be-91ab-4219-b234-b087051886eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:55.568288 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:55.592984 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb23a32-da69-4d7d-8538-d365c4ff92cf req-1b129c7c-8ff4-481f-a0e2-b2e4a71bc048 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:55.594475 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-dfb23a32-da69-4d7d-8538-d365c4ff92cf req-1b129c7c-8ff4-481f-a0e2-b2e4a71bc048 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 944 time: 0.0491433 Nov 12 15:05:55.643640 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-dfb23a32-da69-4d7d-8538-d365c4ff92cf req-d123bd5f-465e-48ff-8143-55f9fd8f7ab5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0432601 Nov 12 15:05:56.135769 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:05:56.184472 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:05:56.188564 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:05:56.188938 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:56.269260 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:56.292271 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:05:56.294556 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cef89f91-5ec0-4f42-a3bc-8e7a9640f624" -d '{"events": [{"server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "name": "network-vif-plugged", "status": "completed", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:05:56.307985 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:05:56.312331 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:56.360355 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:56.389809 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:05:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be5bbd29-3908-4c1f-8d53-afff5657f6e7 x-openstack-request-id: req-be5bbd29-3908-4c1f-8d53-afff5657f6e7 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:05:56.390101 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "name": "network-vif-plugged", "status": "completed", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:05:56.390353 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-be5bbd29-3908-4c1f-8d53-afff5657f6e7 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:05:56.390746 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'code': 200} Nov 12 15:05:56.612420 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f29937a-1c72-4449-9d51-03bb4159224a req-45b98a11-6358-41e0-b317-8da502ed407e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:56.614487 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2f29937a-1c72-4449-9d51-03bb4159224a req-45b98a11-6358-41e0-b317-8da502ed407e service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 1098 time: 0.0469990 Nov 12 15:05:56.664761 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-2f29937a-1c72-4449-9d51-03bb4159224a req-4b9c71f0-a0f6-460a-998a-ba57821db020 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0399361 Nov 12 15:05:56.761160 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b41110c0-2b29-42df-9457-9846472ddff3 req-d23385bc-1d88-4944-afe5-cfa499bb56d0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:56.762933 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b41110c0-2b29-42df-9457-9846472ddff3 req-d23385bc-1d88-4944-afe5-cfa499bb56d0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 945 time: 0.0529048 Nov 12 15:05:56.812022 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-b41110c0-2b29-42df-9457-9846472ddff3 req-e9160c56-14df-443c-9079-665f989d87cc tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0431454 Nov 12 15:05:56.977603 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:57.931336 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46256edd-6708-4a42-b522-b479f9157d49 req-9efb576c-4f1b-4686-a8bf-ddf4e15ee637 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:57.932861 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-46256edd-6708-4a42-b522-b479f9157d49 req-9efb576c-4f1b-4686-a8bf-ddf4e15ee637 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 945 time: 0.0512626 Nov 12 15:05:57.936381 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:57.982340 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-46256edd-6708-4a42-b522-b479f9157d49 req-3b7e7d7c-c985-4ec2-b3d6-a763f02be647 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0425632 Nov 12 15:05:58.096242 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55ad1fcb-5304-43c0-ad12-dd47b72fc4fe req-18ead094-0347-4034-ba66-55ed32be3fa1 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:58.097722 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-55ad1fcb-5304-43c0-ad12-dd47b72fc4fe req-18ead094-0347-4034-ba66-55ed32be3fa1 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 945 time: 0.0486250 Nov 12 15:05:58.146133 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-55ad1fcb-5304-43c0-ad12-dd47b72fc4fe req-bc9fe095-fed9-4703-b742-c59c82905c2e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0425119 Nov 12 15:05:58.167653 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35394) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:58.206341 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7b135cd-b1a5-4465-a2a2-87019a86221e tempest-TestVolumeBootPattern-887431830 tempest-TestVolumeBootPattern-887431830-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:58.207853 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-b7b135cd-b1a5-4465-a2a2-87019a86221e tempest-TestVolumeBootPattern-887431830 tempest-TestVolumeBootPattern-887431830-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 1093 time: 0.0392096 Nov 12 15:05:58.210656 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35396) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:05:58.214795 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'floatingip': {'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address': '172.20.0.5'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:05:58.237605 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:58.332944 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:58.438353 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Allocated IP 172.27.3.249 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/31b8fc36-92f0-41e3-b51f-04fed40d3bbb) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:05:58.546584 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:58.579147 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:58.613453 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:05:58.617547 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:05:58.622969 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:05:58.650195 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'Port': ['ID=31b8fc36-92f0-41e3-b51f-04fed40d3bbb,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:58.979057 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:59.044372 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:59.194320 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for port, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:59.199090 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7428717'] for port, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:59.267265 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'Port': ['ID=31b8fc36-92f0-41e3-b51f-04fed40d3bbb,revision_number=2']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:05:59.280678 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:59.379945 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.l3_db [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Floating IP 02e03648-8b21-4bec-ac98-02fab14d15e5 associated. External IP: 172.27.3.249, port: 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83. Nov 12 15:05:59.586055 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Router 8ec4de9e-dbf9-4aec-bff5-67be839601cd has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:05:59.687605 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:05:59.698098 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] Sync routers for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:05:59.705756 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:05:59.708234 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:05:59.708849 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:05:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:05:59.735825 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-861cc0d3-096e-48f7-b42a-647f40268e6a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.5241640 Nov 12 15:05:59.736529 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83'}] {{(pid=101617) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:05:59.739363 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a89741189a1474522a3f12d6512a4dfa907db76ed85a3c525a03538a87d7317" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cdd85e36-c137-4c69-9d04-5abbf51e3c50" -d '{"events": [{"name": "network-changed", "server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83"}]}' {{(pid=101617) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:05:59.814389 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:05:59.835957 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:05:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a93a6f81-bdf0-430b-bece-a899f1c9e6b1 x-openstack-request-id: req-a93a6f81-bdf0-430b-bece-a899f1c9e6b1 {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:05:59.836325 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83", "status": "completed", "code": 200}]} {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:05:59.836521 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-a93a6f81-bdf0-430b-bece-a899f1c9e6b1 {{(pid=101617) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:05:59.836911 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'status': 'completed', 'code': 200} Nov 12 15:05:59.897849 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-4e0c239e-ca7e-4deb-8c97-a0666ced9827 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:59.899313 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-4e0c239e-ca7e-4deb-8c97-a0666ced9827 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 1098 time: 0.0414011 Nov 12 15:05:59.995640 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-d07c1592-292a-4899-be97-5f0be5ae262b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:05:59.997171 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-d07c1592-292a-4899-be97-5f0be5ae262b service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.0908167 Nov 12 15:06:00.069235 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-e50eb9b5-f822-423f-b5fd-d28ab57f9e67 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 HTTP/1.1" status: 200 len: 999 time: 0.0629776 Nov 12 15:06:00.121996 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-72498cff-2097-4213-9cf8-2754c4413d7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:06:00.123360 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-72498cff-2097-4213-9cf8-2754c4413d7d service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0475209 Nov 12 15:06:00.170851 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-6c54ac83-454b-4caf-9091-a7f1fdcdef45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:06:00.172381 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-6c54ac83-454b-4caf-9091-a7f1fdcdef45 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419819 Nov 12 15:06:00.172729 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '02e03648-8b21-4bec-ac98-02fab14d15e5', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.249', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:05:58Z', 'updated_at': '2021-11-12T15:05:58Z', 'revision_number': 0, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:06:00.200657 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] Checking router: 8ec4de9e-dbf9-4aec-bff5-67be839601cd for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:06:00.209439 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:06:00.210053 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:05:55Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:06:00.265947 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-a1e20c29-0176-4f8b-9b37-b12792f5a187 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857055 Nov 12 15:06:00.313957 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:06:00.354611 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-cdd85e36-c137-4c69-9d04-5abbf51e3c50 req-435192d5-d5ef-4f26-ad50-b6c2923f8bdb service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0804272 Nov 12 15:06:00.552610 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '02e03648-8b21-4bec-ac98-02fab14d15e5', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.249', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:05:58Z', 'updated_at': '2021-11-12T15:05:58Z', 'revision_number': 0, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:06:00.578260 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-189f49a0-1ebf-47c7-a228-789e3803dbf8 None None] The sync data for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi is: [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '02e03648-8b21-4bec-ac98-02fab14d15e5', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.249', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:05:58Z', 'updated_at': '2021-11-12T15:05:58Z', 'revision_number': 0, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:06:00.767657 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-507117ff-65f5-414b-a3ce-675e44584c0e None None] New status for floating IP 02e03648-8b21-4bec-ac98-02fab14d15e5: ACTIVE {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:06:05.008958 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:11.749867 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-beadbeb4-fc6a-4961-b494-3407bfaea03f service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0393894 Nov 12 15:06:11.837206 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-6d06e4ad-9c1c-4600-8297-8f43de2098bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:06:11.838683 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-6d06e4ad-9c1c-4600-8297-8f43de2098bd service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 1098 time: 0.0447843 Nov 12 15:06:11.943739 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-e280b4b3-2dd4-42d7-a651-65a17391a50e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:06:11.945130 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-e280b4b3-2dd4-42d7-a651-65a17391a50e service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.0845346 Nov 12 15:06:12.013765 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-a696ec99-81d7-425e-bd44-08eb5d8648f6 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 HTTP/1.1" status: 200 len: 1001 time: 0.0609469 Nov 12 15:06:12.063839 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-594d5604-97b3-4ca9-bc75-587f1d371563 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:06:12.065268 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-594d5604-97b3-4ca9-bc75-587f1d371563 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0428028 Nov 12 15:06:12.115023 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-73f88158-ebe3-4fd3-b2aa-5616b526d129 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:06:12.116523 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-73f88158-ebe3-4fd3-b2aa-5616b526d129 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402780 Nov 12 15:06:12.212251 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-ae5ba412-32e1-4fb3-9fdd-6edc55a9224b service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879655 Nov 12 15:06:12.299849 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-5977fcf3-64e6-40b4-8dd3-c4256a81d6aa req-e5537532-e2c8-4d6d-aaae-aafdc6bc59a2 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0807645 Nov 12 15:06:22.107611 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e032c8cc-6eca-459d-94b2-caf3bd570509 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:24.549768 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-9016fd80-450b-4513-af88-a7b5c763c6bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:25.570764 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:26.339200 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:06:26.979755 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:27.939490 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:35.021638 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:52.109413 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-4c6aba79-3428-42e6-95c9-3ee2d4d18a9f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:54.553482 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5adfda7a-b171-478a-8e81-e1b652801a01 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:55.574180 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:56.984050 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:06:57.940484 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:03.341127 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:07:05.039047 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:12.750905 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-38b5a28c-778d-4a15-8929-42e7808c9312 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0438070 Nov 12 15:07:12.834130 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-c5b05285-65bb-435e-9a6a-e0fa3d0f5a0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:12.835593 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-c5b05285-65bb-435e-9a6a-e0fa3d0f5a0f service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 1098 time: 0.0405424 Nov 12 15:07:12.938786 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-e73aa172-411e-43b3-913c-de391569d9d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:12.940264 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-e73aa172-411e-43b3-913c-de391569d9d4 service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.0859501 Nov 12 15:07:13.013602 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-32689b5a-3194-4ba3-b771-21ebca0334c0 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 HTTP/1.1" status: 200 len: 1001 time: 0.0635009 Nov 12 15:07:13.063992 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-a6302169-2667-4237-b59d-85f112e933e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:13.065822 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-a6302169-2667-4237-b59d-85f112e933e8 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0455985 Nov 12 15:07:13.111347 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-996b45f3-15ef-41dc-9ec5-9a76ca13bb6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:13.112842 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-996b45f3-15ef-41dc-9ec5-9a76ca13bb6b service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0395546 Nov 12 15:07:13.206108 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-2b70d615-d336-4f2f-a48f-e5a9fb5e0680 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846722 Nov 12 15:07:13.295982 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-50c0551e-1e9d-4297-b486-d94894cc94fb req-6b2e071f-426d-4e30-9e50-adeba43d7fc4 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831435 Nov 12 15:07:22.111154 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6332bec9-76b0-40ca-ab71-238d603dea74 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:24.554285 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f6cc06f5-ab06-4ab4-bc04-ac7d730c2363 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:25.576710 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:26.987176 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:27.942868 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:34.383078 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-e8a93ec1-a59a-4a57-9a25-9a0b1bef2025 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-61519927&fields=id&tenant_id=e0bd63a24fe9453c84dae6d5536c0df9 HTTP/1.1" status: 200 len: 267 time: 0.0450656 Nov 12 15:07:34.490814 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-db108b80-56e3-4022-98a5-03c2d32fd35c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:34.492416 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-db108b80-56e3-4022-98a5-03c2d32fd35c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 811 time: 0.1022692 Nov 12 15:07:34.509134 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-134bd0cb-eb6f-46ef-981b-e62f8089cc0e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/quotas/e0bd63a24fe9453c84dae6d5536c0df9 HTTP/1.1" status: 200 len: 375 time: 0.0110030 Nov 12 15:07:34.573447 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-ca6b5297-4b25-4aaa-9905-d861dc661842 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0576355 Nov 12 15:07:34.673966 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-7b808ac4-3d00-4368-9001-0059806d8093 service neutron] 10.222.0.61 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876176 Nov 12 15:07:34.997994 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-1dcc3483-61a3-44f2-b0d7-653561bedbb6 service neutron] 10.222.0.61 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3173718 Nov 12 15:07:35.054993 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:35.290702 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-d89d6494-2d42-47b4-999b-14699e759231 req-349f7e8b-46bb-4492-9955-3f5fce7b3f31 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 210 time: 0.0370588 Nov 12 15:07:36.217022 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-8e4edcf0-cf2b-4997-b348-3109afd0c76d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:36.218484 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-8e4edcf0-cf2b-4997-b348-3109afd0c76d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 811 time: 0.1045156 Nov 12 15:07:36.287661 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-e7c208ff-533a-45ab-80db-4ff245d7a181 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e0bd63a24fe9453c84dae6d5536c0df9 HTTP/1.1" status: 200 len: 378 time: 0.0594883 Nov 12 15:07:36.297393 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'port': {'device_id': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'admin_state_up': True, 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'security_groups': ['df9b544e-58f6-4924-9387-7a81ef202db0']}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:07:36.387456 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-386a0612-cdef-4b15-90d8-fb5de17b228b req-a82acc8e-81ec-4b7c-b14a-dd4e5340c35a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 210 time: 0.0277689 Nov 12 15:07:36.417626 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Made reservation on behalf of e0bd63a24fe9453c84dae6d5536c0df9 for: {'port': 1} {{(pid=101618) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 12 15:07:36.421127 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:36.556453 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.db_base_plugin_common [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Allocated IP 172.20.0.10 (370662ef-db75-4207-9a43-c725449d1d6d/40c8c5f2-e714-4a04-9300-6f56d57e5158/1940f60b-82b6-4dfd-857f-e1112c79e735) {{(pid=101618) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:07:36.701699 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for port, precommit_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:36.735571 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_create {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:36.784073 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Network 370662ef-db75-4207-9a43-c725449d1d6d is already hosted by enough agents. {{(pid=101618) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:07:36.789287 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.base_scheduler [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Resources bound (agent type, host, resource id): {{(pid=101618) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:07:36.793134 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Received port after_create {{(pid=101618) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:07:36.799805 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'Port': ['ID=1940f60b-82b6-4dfd-857f-e1112c79e735,revision_number=1']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:07:36.829503 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.829846 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.830221 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.830547 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.830869 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.831189 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.831507 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.831823 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.832474 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.832474 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.832831 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.833123 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:36.861642 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:36.862292 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:36.881729 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-a38bebed-fb80-4e92-bace-b252efe9b626 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5882769 Nov 12 15:07:36.894758 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.v2.base [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Request body: {'port': {'device_id': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77642'}} {{(pid=101618) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:07:36.951954 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:36.994253 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-5cd2bdcf-89ea-4c3f-ab50-2ede9a248bd4 None None] Provisioning complete for port 1940f60b-82b6-4dfd-857f-e1112c79e735 triggered by entity DHCP. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:07:36.994854 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5cd2bdcf-89ea-4c3f-ab50-2ede9a248bd4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:37.028783 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-5cd2bdcf-89ea-4c3f-ab50-2ede9a248bd4 None None] Port 1940f60b-82b6-4dfd-857f-e1112c79e735 cannot update to ACTIVE because it is not bound. {{(pid=101619) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 12 15:07:37.208601 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1940f60b-82b6-4dfd-857f-e1112c79e735 {{(pid=101618) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:07:37.215721 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Publish callbacks [] for port, precommit_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:37.227566 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.provisioning_blocks [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Transition to ACTIVE for port object 1940f60b-82b6-4dfd-857f-e1112c79e735 will not be triggered until provisioned by entity L2. {{(pid=101618) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 12 15:07:37.232064 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:37.281807 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Pushing event updated for resources: {'Port': ['ID=1940f60b-82b6-4dfd-857f-e1112c79e735,revision_number=2']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:07:37.352169 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Attempting to bind port 1940f60b-82b6-4dfd-857f-e1112c79e735 on host hv-cinder-77642 for vnic_type normal with profile {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 12 15:07:37.352831 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Attempting to bind port 1940f60b-82b6-4dfd-857f-e1112c79e735 by drivers openvswitch,hyperv on host hv-cinder-77642 at level 0 using segments [{'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 12 15:07:37.352974 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Attempting to bind port 1940f60b-82b6-4dfd-857f-e1112c79e735 on network 370662ef-db75-4207-9a43-c725449d1d6d {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:07:37.357720 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Port 1940f60b-82b6-4dfd-857f-e1112c79e735 on network 370662ef-db75-4207-9a43-c725449d1d6d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77642 {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 12 15:07:37.358044 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Attempting to bind port 1940f60b-82b6-4dfd-857f-e1112c79e735 on network 370662ef-db75-4207-9a43-c725449d1d6d {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 12 15:07:37.363197 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Checking agent: {'id': 'e6690ba9-40f9-4361-ac58-a72594e62538', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77642', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'started_at': datetime.datetime(2021, 11, 12, 14, 53, 5), 'heartbeat_timestamp': datetime.datetime(2021, 11, 12, 15, 7, 35), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 12 15:07:37.363568 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Checking segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=101618) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 12 15:07:37.363955 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Bound using segment: {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'} {{(pid=101618) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 12 15:07:37.364411 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.managers [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Bound port: 1940f60b-82b6-4dfd-857f-e1112c79e735, host: hv-cinder-77642, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b5ad6a85-de19-49b7-8ae4-bab83ada0933', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 605, 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d'}}] {{(pid=101618) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 12 15:07:37.364764 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:37.433713 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] For port 1940f60b-82b6-4dfd-857f-e1112c79e735, host hv-cinder-77642, cleared binding levels {{(pid=101618) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 12 15:07:37.437095 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] For port 1940f60b-82b6-4dfd-857f-e1112c79e735, host hv-cinder-77642, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1940f60b-82b6-4dfd-857f-e1112c79e735,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101618) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 12 15:07:37.441728 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5822960'] for port, after_update {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:37.485824 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:37.486455 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:37.487784 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] 10.222.0.86 "PUT /v2.0/ports/1940f60b-82b6-4dfd-857f-e1112c79e735 HTTP/1.1" status: 200 len: 1094 time: 0.5974126 Nov 12 15:07:37.491075 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:07:37.494553 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b435587-6b27-4129-9e7e-148931aebb84" -d '{"events": [{"name": "network-changed", "server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:07:37.547030 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:07:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb619bdb-e79e-452f-bd08-2806909ab24a x-openstack-request-id: req-fb619bdb-e79e-452f-bd08-2806909ab24a {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:07:37.547313 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:07:37.547568 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-fb619bdb-e79e-452f-bd08-2806909ab24a {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:07:37.547962 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'status': 'completed', 'code': 200} Nov 12 15:07:37.562264 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c415ae-c479-4fb9-b69c-233318156f93 service neutron] Pushing event updated for resources: {'Port': ['ID=1940f60b-82b6-4dfd-857f-e1112c79e735,revision_number=3']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:07:37.588941 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e010ed6b-de7a-4890-a11f-c044abfffbfb req-e5ea5bbb-577c-44df-ba6a-7679bbda4053 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:37.590501 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e010ed6b-de7a-4890-a11f-c044abfffbfb req-e5ea5bbb-577c-44df-ba6a-7679bbda4053 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 944 time: 0.1214495 Nov 12 15:07:37.600653 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-d410e35a-8487-46dc-b317-bb3622d96047 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:37.602107 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-d410e35a-8487-46dc-b317-bb3622d96047 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 1097 time: 0.0695040 Nov 12 15:07:37.658720 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-80181eb4-d0c6-4639-ba25-c6fc8e17f62e service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1940f60b-82b6-4dfd-857f-e1112c79e735 HTTP/1.1" status: 200 len: 217 time: 0.0397229 Nov 12 15:07:37.711700 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e010ed6b-de7a-4890-a11f-c044abfffbfb req-d4c3baa4-775e-43bc-a87b-acf7c42f7d1b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1141613 Nov 12 15:07:37.725256 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-f110cd27-ce91-4ba3-8834-1cecccb01796 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:37.726720 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-f110cd27-ce91-4ba3-8834-1cecccb01796 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0614705 Nov 12 15:07:37.777677 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-b22c176b-69d3-4b2a-8af3-7ed1dbebf615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:37.779203 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-b22c176b-69d3-4b2a-8af3-7ed1dbebf615 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0453379 Nov 12 15:07:37.874256 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-46c6475c-d3ff-4ce7-962c-2391bf227dc1 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879104 Nov 12 15:07:37.974916 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-44d74bed-c9c8-47bf-8a95-dae535f180ae req-97c9ca2d-8a44-495f-ae39-9d4c8bd911a7 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0932500 Nov 12 15:07:38.325633 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b435587-6b27-4129-9e7e-148931aebb84 req-8251cca7-bb69-445f-a3ac-b27680415e32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:38.327199 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b435587-6b27-4129-9e7e-148931aebb84 req-8251cca7-bb69-445f-a3ac-b27680415e32 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 1097 time: 0.3061190 Nov 12 15:07:38.420294 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b435587-6b27-4129-9e7e-148931aebb84 req-19af4c83-a353-4fba-96ec-958a16f76807 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:38.421749 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b435587-6b27-4129-9e7e-148931aebb84 req-19af4c83-a353-4fba-96ec-958a16f76807 service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.0845277 Nov 12 15:07:38.468907 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b435587-6b27-4129-9e7e-148931aebb84 req-a5899307-2f4e-4305-b0fb-5b5f93fa3d90 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1940f60b-82b6-4dfd-857f-e1112c79e735 HTTP/1.1" status: 200 len: 217 time: 0.0368924 Nov 12 15:07:38.518061 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b435587-6b27-4129-9e7e-148931aebb84 req-2feb9575-13d6-459c-a69d-b0dacc707d29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:38.519485 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b435587-6b27-4129-9e7e-148931aebb84 req-2feb9575-13d6-459c-a69d-b0dacc707d29 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0435891 Nov 12 15:07:38.565173 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b435587-6b27-4129-9e7e-148931aebb84 req-798e5aa9-9d4d-4047-8ec0-70276436548c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:38.567180 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b435587-6b27-4129-9e7e-148931aebb84 req-798e5aa9-9d4d-4047-8ec0-70276436548c service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398417 Nov 12 15:07:38.660714 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b435587-6b27-4129-9e7e-148931aebb84 req-3248779d-b78b-4926-8381-649bc52b5ff4 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866272 Nov 12 15:07:38.754422 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4b435587-6b27-4129-9e7e-148931aebb84 req-98afc9e5-5a73-4f40-a812-45fee542d8b3 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863760 Nov 12 15:07:38.833732 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b28a9df-40a4-418d-931f-39f00f9f007e req-083fc141-478d-48d0-893c-3a019d24686e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:38.835225 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9b28a9df-40a4-418d-931f-39f00f9f007e req-083fc141-478d-48d0-893c-3a019d24686e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 944 time: 0.0503328 Nov 12 15:07:38.884941 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9b28a9df-40a4-418d-931f-39f00f9f007e req-ddb02f3e-47a3-4924-a856-8768fac10f4a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0435522 Nov 12 15:07:40.005812 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d10777e-84e9-4fe4-87cb-6f0541f10113 req-0e6c442b-1f2f-448b-8337-0c3168e68ebf tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:40.007360 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8d10777e-84e9-4fe4-87cb-6f0541f10113 req-0e6c442b-1f2f-448b-8337-0c3168e68ebf tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 944 time: 0.0541089 Nov 12 15:07:40.058502 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-8d10777e-84e9-4fe4-87cb-6f0541f10113 req-d904529a-5a5e-4984-9d80-1f67eefd176e tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0451245 Nov 12 15:07:40.339902 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:07:41.179913 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e7bae23-ca4e-44af-ace0-4c07e524d94d req-933a63cf-2c56-436c-9bef-b976b498a3b5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:41.181499 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7e7bae23-ca4e-44af-ace0-4c07e524d94d req-933a63cf-2c56-436c-9bef-b976b498a3b5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 944 time: 0.0561378 Nov 12 15:07:41.233109 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7e7bae23-ca4e-44af-ace0-4c07e524d94d req-b42da00d-c5f7-4406-ad2c-287d34bc268d tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0454357 Nov 12 15:07:42.347918 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33be3aa3-9a09-4650-bf25-de6be0380e6a req-2262daca-2257-46ea-af8d-f496519a3815 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:42.349400 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-33be3aa3-9a09-4650-bf25-de6be0380e6a req-2262daca-2257-46ea-af8d-f496519a3815 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 944 time: 0.0487356 Nov 12 15:07:42.399055 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-33be3aa3-9a09-4650-bf25-de6be0380e6a req-6407a18e-e9cb-4b6a-8b39-ad040f59a8c4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0437105 Nov 12 15:07:43.515963 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b472ab7-51ba-4cdd-94dc-3dab7abc598f req-3ad395e5-76c4-4138-bb18-9a25a1393ba8 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:43.517522 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8b472ab7-51ba-4cdd-94dc-3dab7abc598f req-3ad395e5-76c4-4138-bb18-9a25a1393ba8 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 944 time: 0.0497313 Nov 12 15:07:43.569630 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-8b472ab7-51ba-4cdd-94dc-3dab7abc598f req-9b24d86c-36f8-4d09-b5c0-8ae9c52baa95 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0461330 Nov 12 15:07:44.691294 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d8f371-0fda-48ba-94fd-a29bcef81b62 req-9049f5b1-3663-4e6f-9bf2-dad4e447a638 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:44.693404 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-56d8f371-0fda-48ba-94fd-a29bcef81b62 req-9049f5b1-3663-4e6f-9bf2-dad4e447a638 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 944 time: 0.0548778 Nov 12 15:07:44.698140 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1940f60b-82b6-4dfd-857f-e1112c79e735 details requested by agent hyperv_hv-cinder-77642 with host hv-cinder-77642 {{(pid=101619) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 12 15:07:44.758787 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-56d8f371-0fda-48ba-94fd-a29bcef81b62 req-8fd944e7-e8f7-4cdd-b3e5-43b148298f1f tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0589366 Nov 12 15:07:44.803021 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 1940f60b-82b6-4dfd-857f-e1112c79e735, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1940f60b-82b6-4dfd-857f-e1112c79e735,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:07:44.815358 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Returning: {'device': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'port_id': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'mac_address': 'fa:16:3e:d7:78:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 605, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=101619) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 12 15:07:44.852781 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:44.866694 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1940f60b-82b6-4dfd-857f-e1112c79e735 {{(pid=101619) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 12 15:07:44.886937 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 1940f60b-82b6-4dfd-857f-e1112c79e735, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1940f60b-82b6-4dfd-857f-e1112c79e735,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:07:44.891350 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:44.945222 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=1940f60b-82b6-4dfd-857f-e1112c79e735,revision_number=4']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:07:44.952440 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.952799 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.953147 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.953501 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.953832 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.954155 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.954477 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.954792 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.955117 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.955439 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.955757 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:44.956067 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:45.149182 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] get_ports_and_sgs() called for port_ids ['1940f60b-82b6-4dfd-857f-e1112c79e735'] {{(pid=101619) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 12 15:07:45.877093 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f85cec2-8d0f-435e-9864-0294fb48611c req-da67046a-ae7b-45bc-9254-a0c15d5e12d7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:45.878605 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9f85cec2-8d0f-435e-9864-0294fb48611c req-da67046a-ae7b-45bc-9254-a0c15d5e12d7 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 945 time: 0.0496199 Nov 12 15:07:45.934383 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-9f85cec2-8d0f-435e-9864-0294fb48611c req-1c62a8fa-bf7f-4cfc-a6e1-07c96f2ce490 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0492287 Nov 12 15:07:46.714300 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1940f60b-82b6-4dfd-857f-e1112c79e735 up at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 12 15:07:46.765784 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning for port 1940f60b-82b6-4dfd-857f-e1112c79e735 completed by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 12 15:07:46.770838 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.provisioning_blocks [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Provisioning complete for port 1940f60b-82b6-4dfd-857f-e1112c79e735 triggered by entity L2. {{(pid=101619) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 12 15:07:46.771208 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-657960'] for port, provisioning_complete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:46.852913 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:46.875888 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735'}] {{(pid=101619) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:07:46.878268 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0e55d78186f92c6109d410f3f707a9eacaca5bcabf9c5b25d012d0357c44c68d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ced20c12-0aa5-4dd6-be4a-ee21421bd819" -d '{"events": [{"server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "name": "network-vif-plugged", "status": "completed", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735"}]}' {{(pid=101619) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:07:46.891631 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] For port 1940f60b-82b6-4dfd-857f-e1112c79e735, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1940f60b-82b6-4dfd-857f-e1112c79e735,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:07:46.896715 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144'] for port, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:46.920412 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:07:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18e42536-6365-4f37-8923-0e47b9b2edf1 x-openstack-request-id: req-18e42536-6365-4f37-8923-0e47b9b2edf1 {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:07:46.920702 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "name": "network-vif-plugged", "status": "completed", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735", "code": 200}]} {{(pid=101619) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:07:46.920954 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-18e42536-6365-4f37-8923-0e47b9b2edf1 {{(pid=101619) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:07:46.921334 dv-cinder-776422-5-iscsi neutron-server[101619]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'code': 200} Nov 12 15:07:46.949303 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Pushing event updated for resources: {'Port': ['ID=1940f60b-82b6-4dfd-857f-e1112c79e735,revision_number=5']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:07:47.057458 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4584d5e-3ac7-46dc-9289-0059a50ab064 req-202edce9-731f-40fc-93ef-aa4f25f010e5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:47.058953 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a4584d5e-3ac7-46dc-9289-0059a50ab064 req-202edce9-731f-40fc-93ef-aa4f25f010e5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 946 time: 0.0571232 Nov 12 15:07:47.115263 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-a4584d5e-3ac7-46dc-9289-0059a50ab064 req-a01a8b35-a7ca-4eeb-a0c4-40dcaa530204 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0493202 Nov 12 15:07:47.150040 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa97845c-e64e-442b-81d1-f0a6e4baa357 req-fabbefa1-b8e3-4236-a627-615d53c2e4aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:47.151533 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa97845c-e64e-442b-81d1-f0a6e4baa357 req-fabbefa1-b8e3-4236-a627-615d53c2e4aa service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 1099 time: 0.0436802 Nov 12 15:07:47.201856 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-aa97845c-e64e-442b-81d1-f0a6e4baa357 req-264f8283-3da3-4c41-96f5-f3042c1ab620 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0427465 Nov 12 15:07:48.260485 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18bd0836-97e8-4336-9c4a-c19ab7f32ca4 req-c47252de-3fa3-4882-b89e-9e471ab50e90 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:48.262437 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18bd0836-97e8-4336-9c4a-c19ab7f32ca4 req-c47252de-3fa3-4882-b89e-9e471ab50e90 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 946 time: 0.0527389 Nov 12 15:07:48.328304 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-18bd0836-97e8-4336-9c4a-c19ab7f32ca4 req-75ff0f98-6984-437a-bf22-068c0f65db71 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0593297 Nov 12 15:07:49.451810 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f882f22-f197-4fd9-a166-805cb375fbbc req-04f26f51-1f4e-4a99-901e-549c589f4331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:49.453425 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7f882f22-f197-4fd9-a166-805cb375fbbc req-04f26f51-1f4e-4a99-901e-549c589f4331 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 946 time: 0.0560095 Nov 12 15:07:49.506455 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-7f882f22-f197-4fd9-a166-805cb375fbbc req-fccea4da-73b6-4e58-9691-55fd2d7dc41b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0467603 Nov 12 15:07:49.622841 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-137cabbb-a911-4974-b08f-4fc5154a10eb req-622719ac-8f7a-423c-a350-e019a4affae4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:49.624304 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-137cabbb-a911-4974-b08f-4fc5154a10eb req-622719ac-8f7a-423c-a350-e019a4affae4 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 946 time: 0.0501184 Nov 12 15:07:49.675739 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-137cabbb-a911-4974-b08f-4fc5154a10eb req-e5a0dc18-4522-400f-bae7-34696374512a tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0447037 Nov 12 15:07:49.698550 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35524) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:07:49.743968 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c5aa3e4-9c41-43ae-b1bc-970a6db5965d tempest-TestVolumeBootPattern-887431830 tempest-TestVolumeBootPattern-887431830-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:49.745534 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-5c5aa3e4-9c41-43ae-b1bc-970a6db5965d tempest-TestVolumeBootPattern-887431830 tempest-TestVolumeBootPattern-887431830-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 1094 time: 0.0459707 Nov 12 15:07:49.748410 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35526) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:07:49.752897 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.v2.base [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Request body: {'floatingip': {'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'port_id': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address': '172.20.0.10'}} {{(pid=101617) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 12 15:07:49.777793 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:49.876717 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:49.993303 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_common [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Allocated IP 172.27.3.173 (bc8f81a5-42b5-4692-9e4b-bc049497e795/f1d69314-a0d5-4375-876e-6ed7c4b8fa75/3bc41e63-9207-4e57-8693-98410812d25c) {{(pid=101617) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 12 15:07:50.099904 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for port, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:50.135259 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8744642121108', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:50.178444 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Network bc8f81a5-42b5-4692-9e4b-bc049497e795 is already hosted by enough agents. {{(pid=101617) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 12 15:07:50.183880 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.base_scheduler [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Resources bound (agent type, host, resource id): {{(pid=101617) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 12 15:07:50.188707 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Received port after_create {{(pid=101617) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 12 15:07:50.213660 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'Port': ['ID=3bc41e63-9207-4e57-8693-98410812d25c,revision_number=1']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:07:50.225996 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.226345 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.226689 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.227021 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.227350 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.227680 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.228013 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.228377 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.228703 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.229024 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.229351 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.229668 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:07:50.570194 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, precommit_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:50.645893 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-537705'] for port, before_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:50.803000 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for port, precommit_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:50.808367 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8744642596500', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8744642121126', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8744642121144', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-7428717'] for port, after_update {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:50.876813 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event updated for resources: {'Port': ['ID=3bc41e63-9207-4e57-8693-98410812d25c,revision_number=2']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:07:50.892250 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1760223'] for floatingip, after_create {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:50.996460 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.db.l3_db [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Floating IP 477405fc-f51c-4567-aee1-0b0ff289245c associated. External IP: 172.27.3.173, port: 1940f60b-82b6-4dfd-857f-e1112c79e735. Nov 12 15:07:51.209768 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Router 8ec4de9e-dbf9-4aec-bff5-67be839601cd has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:07:51.319541 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:07:51.329730 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] Sync routers for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:07:51.338894 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:51.341897 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:07:51.342529 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:07:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:07:51.367621 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-fd05db27-9a07-458f-aae8-d7a480e50018 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.6181664 Nov 12 15:07:51.368972 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735'}] {{(pid=101617) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:07:51.370949 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8a89741189a1474522a3f12d6512a4dfa907db76ed85a3c525a03538a87d7317" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-967425c5-b4ff-4022-9370-180a47b02058" -d '{"events": [{"name": "network-changed", "server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735"}]}' {{(pid=101617) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:07:51.408364 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:07:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-331fe2c4-5e92-4b19-b395-a4ce85697e04 x-openstack-request-id: req-331fe2c4-5e92-4b19-b395-a4ce85697e04 {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:07:51.408656 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735", "status": "completed", "code": 200}]} {{(pid=101617) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:07:51.408916 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-331fe2c4-5e92-4b19-b395-a4ce85697e04 {{(pid=101617) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:07:51.409322 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'status': 'completed', 'code': 200} Nov 12 15:07:51.455570 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:07:51.473720 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967425c5-b4ff-4022-9370-180a47b02058 req-bc7aca81-80af-41d3-8818-d1dee7d14da9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:51.475258 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-967425c5-b4ff-4022-9370-180a47b02058 req-bc7aca81-80af-41d3-8818-d1dee7d14da9 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 1099 time: 0.0425107 Nov 12 15:07:51.572730 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967425c5-b4ff-4022-9370-180a47b02058 req-d7eb3ea5-3d1e-452e-ab45-52c38d22f123 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:51.574178 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-967425c5-b4ff-4022-9370-180a47b02058 req-d7eb3ea5-3d1e-452e-ab45-52c38d22f123 service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.0924780 Nov 12 15:07:51.640789 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-967425c5-b4ff-4022-9370-180a47b02058 req-930154d6-321e-4151-90b4-54c412f79107 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1940f60b-82b6-4dfd-857f-e1112c79e735 HTTP/1.1" status: 200 len: 1000 time: 0.0588341 Nov 12 15:07:51.691299 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '02e03648-8b21-4bec-ac98-02fab14d15e5', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.249', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:05:58Z', 'updated_at': '2021-11-12T15:06:00Z', 'revision_number': 1, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}, {'id': '477405fc-f51c-4567-aee1-0b0ff289245c', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.173', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:d7:78:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:07:50Z', 'updated_at': '2021-11-12T15:07:50Z', 'revision_number': 0, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:07:51.694353 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967425c5-b4ff-4022-9370-180a47b02058 req-511d8205-01ff-4566-bc38-4dccc0fb65e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:51.696067 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-967425c5-b4ff-4022-9370-180a47b02058 req-511d8205-01ff-4566-bc38-4dccc0fb65e0 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0483441 Nov 12 15:07:51.718537 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] Checking router: 8ec4de9e-dbf9-4aec-bff5-67be839601cd for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:07:51.727688 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:07:51.728251 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:07:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:07:51.744394 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967425c5-b4ff-4022-9370-180a47b02058 req-9f141f06-9977-4a76-b9cf-49b0a2098efd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:07:51.745900 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-967425c5-b4ff-4022-9370-180a47b02058 req-9f141f06-9977-4a76-b9cf-49b0a2098efd service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427315 Nov 12 15:07:51.838889 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-967425c5-b4ff-4022-9370-180a47b02058 req-c6c1e995-b078-4ee3-9c04-90701807be22 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855129 Nov 12 15:07:51.840507 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:07:51.934624 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-967425c5-b4ff-4022-9370-180a47b02058 req-68cfae97-5690-4601-a0ce-1aad8a6200b4 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872910 Nov 12 15:07:52.138248 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6ce07a84-7282-4754-b5c6-ad444b180cb5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:52.210647 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '02e03648-8b21-4bec-ac98-02fab14d15e5', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.249', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:05:58Z', 'updated_at': '2021-11-12T15:06:00Z', 'revision_number': 1, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}, {'id': '477405fc-f51c-4567-aee1-0b0ff289245c', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.173', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:d7:78:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:07:50Z', 'updated_at': '2021-11-12T15:07:50Z', 'revision_number': 0, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:07:52.235976 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3280e172-2b58-4059-983c-c79e3f567ae3 None None] The sync data for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi is: [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '02e03648-8b21-4bec-ac98-02fab14d15e5', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.249', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:05:58Z', 'updated_at': '2021-11-12T15:06:00Z', 'revision_number': 1, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}, {'id': '477405fc-f51c-4567-aee1-0b0ff289245c', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.173', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:d7:78:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:07:50Z', 'updated_at': '2021-11-12T15:07:50Z', 'revision_number': 0, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:07:52.427385 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32f6f9dc-6469-40a7-a288-aec81cc1fb3f None None] New status for floating IP 477405fc-f51c-4567-aee1-0b0ff289245c: ACTIVE {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:07:54.556324 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6a6dd4c9-27ad-4331-9f08-ac66c3acf7e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:55.579611 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:56.990808 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:07:57.949369 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:05.083875 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:14.740762 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-39c255f9-b61e-4c19-96e2-f00b59b72605 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0397770 Nov 12 15:08:14.825872 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-3d5b51a0-4e95-4b3a-b406-acb1283da930 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:08:14.827358 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-3d5b51a0-4e95-4b3a-b406-acb1283da930 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 1098 time: 0.0413852 Nov 12 15:08:14.937268 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-727ce86e-124d-4249-8b8b-19c177a1dad5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:08:14.938730 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-727ce86e-124d-4249-8b8b-19c177a1dad5 service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.0899570 Nov 12 15:08:15.010779 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-8e443a7a-a010-42af-a472-806ca7d2eb99 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 HTTP/1.1" status: 200 len: 1001 time: 0.0642071 Nov 12 15:08:15.065549 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-a4e41ce8-5b91-4a28-a84d-28829a42779e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:08:15.067045 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-a4e41ce8-5b91-4a28-a84d-28829a42779e service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0484827 Nov 12 15:08:15.114529 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-794a35e9-2fa1-43c7-9eff-a537a9aa783c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:08:15.116011 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-794a35e9-2fa1-43c7-9eff-a537a9aa783c service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0412774 Nov 12 15:08:15.214203 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-61193c85-e2db-415f-9473-fc7e877961b9 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854483 Nov 12 15:08:15.311729 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-f36aa06f-4e93-47cc-b6d2-7e702c3a7034 req-cc760b43-504c-47b7-994d-4b09cf4f3d34 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889122 Nov 12 15:08:17.339583 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:08:22.113771 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-bf2ae489-c44e-49e0-a9d0-c45eb886a094 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:24.558867 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-d9377d41-9a20-497b-82f5-cd0d609cbe94 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:25.586085 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:26.994317 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:27.942082 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:35.102469 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:52.117191 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-1182cf49-d5fc-4b6e-9356-3c98760b63cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:54.338924 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:08:54.568405 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-b0d100f3-76f6-4370-8358-27759995994a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:55.586259 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:56.994789 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:08:57.944324 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:05.115914 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:14.738560 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-ab4ee312-1063-4ef2-be80-e4037f5fe940 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0404470 Nov 12 15:09:14.805239 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-abd32b35-7cbc-4f58-a360-add475c4a47e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:14.806744 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-abd32b35-7cbc-4f58-a360-add475c4a47e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 1099 time: 0.0466237 Nov 12 15:09:14.912568 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-20ded2a6-0337-4b1d-a8e7-d4a84f01a96b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:14.914033 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-20ded2a6-0337-4b1d-a8e7-d4a84f01a96b service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.0876369 Nov 12 15:09:14.983634 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-f8b48144-7201-4906-896c-1a6fbc3c8d91 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1940f60b-82b6-4dfd-857f-e1112c79e735 HTTP/1.1" status: 200 len: 1002 time: 0.0625560 Nov 12 15:09:15.034639 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-3073f195-816f-4bfa-b1c5-a4df00519923 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:15.036137 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-3073f195-816f-4bfa-b1c5-a4df00519923 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0456998 Nov 12 15:09:15.083023 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-4a506221-60d0-4332-964f-cfd64eedebaf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:15.084529 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-4a506221-60d0-4332-964f-cfd64eedebaf service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0414429 Nov 12 15:09:15.182683 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-5b39925d-3a20-4a1e-b4d2-1c2b1949a891 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0903914 Nov 12 15:09:15.280404 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4660557a-9f04-4bf5-bff5-28e9d332b886 req-bee627dd-58dd-437d-9c76-32108b759b14 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896671 Nov 12 15:09:22.122110 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-8f4d275e-064e-48a7-8937-c1065855cc0e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:24.570124 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-33d7906c-65ce-41bd-8e83-5e5b04009a6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:25.588678 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:26.998670 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:27.946938 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:31.339852 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:09:31.437552 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35560) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:31.657299 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Deleting port 3bc41e63-9207-4e57-8693-98410812d25c {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:31.657608 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:31.739222 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:31.739543 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:31.752277 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Calling delete_port for 3bc41e63-9207-4e57-8693-98410812d25c owned by network:floatingip {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:31.903109 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:31.929318 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event deleted for resources: {'Port': ['ID=3bc41e63-9207-4e57-8693-98410812d25c,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:31.955784 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.956172 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.956465 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.956792 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.957115 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.957436 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.957753 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.958072 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.958445 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.958695 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.959006 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:31.959316 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101618) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:32.000884 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:32.001197 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Floating IP 477405fc-f51c-4567-aee1-0b0ff289245c disassociated (deleted). External IP: 172.27.3.173, port: 1940f60b-82b6-4dfd-857f-e1112c79e735. Nov 12 15:09:32.216527 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Router 8ec4de9e-dbf9-4aec-bff5-67be839601cd has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:09:32.329755 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:09:32.335612 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:32.340530 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] Sync routers for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:09:32.351263 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:09:32.351877 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:09:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:32.363678 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-ab22bb45-79ea-412c-bbce-d79b89968159 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "DELETE /v2.0/floatingips/477405fc-f51c-4567-aee1-0b0ff289245c HTTP/1.1" status: 204 len: 168 time: 0.9250374 Nov 12 15:09:32.364390 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:09:32.366737 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ecdb51df-211b-450b-90b5-41f0f42bef92" -d '{"events": [{"name": "network-changed", "server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:09:32.408100 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:09:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0738223d-ebcd-49f2-b4b3-10b60690a289 x-openstack-request-id: req-0738223d-ebcd-49f2-b4b3-10b60690a289 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:09:32.408425 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:09:32.409270 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-0738223d-ebcd-49f2-b4b3-10b60690a289 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:09:32.409722 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'status': 'completed', 'code': 200} Nov 12 15:09:32.461432 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:09:32.481725 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-9a3f73e8-99da-4f37-986e-beab59d0b662 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:32.483244 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-9a3f73e8-99da-4f37-986e-beab59d0b662 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 1099 time: 0.0501940 Nov 12 15:09:32.610126 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-d78e7212-d02f-45c3-82c7-961023784bd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:32.611050 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-d78e7212-d02f-45c3-82c7-961023784bd6 service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.1205759 Nov 12 15:09:32.619640 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5342f2a0-1e5a-42cd-bcfe-526b7b82ce1a req-a7813f98-0ad3-4cf9-a8f5-b6067f67963c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:32.621292 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5342f2a0-1e5a-42cd-bcfe-526b7b82ce1a req-a7813f98-0ad3-4cf9-a8f5-b6067f67963c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 946 time: 0.0548565 Nov 12 15:09:32.658822 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-219e5d15-e93c-4953-a800-549cfe2ce45b service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1940f60b-82b6-4dfd-857f-e1112c79e735 HTTP/1.1" status: 200 len: 217 time: 0.0370617 Nov 12 15:09:32.673833 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-5342f2a0-1e5a-42cd-bcfe-526b7b82ce1a req-208674b8-0f4a-4d1b-923c-f49c907a5b50 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0461948 Nov 12 15:09:32.716459 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-da86aadd-b8f3-4956-8ea3-379a7ce87530 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:32.717915 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-da86aadd-b8f3-4956-8ea3-379a7ce87530 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0506768 Nov 12 15:09:32.724075 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '02e03648-8b21-4bec-ac98-02fab14d15e5', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.249', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:05:58Z', 'updated_at': '2021-11-12T15:06:00Z', 'revision_number': 1, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:32.750797 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] Checking router: 8ec4de9e-dbf9-4aec-bff5-67be839601cd for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:09:32.759716 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:09:32.760382 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:09:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:32.766845 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-cfc62035-0150-403a-bb80-93bd74c7bfd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:32.769042 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-cfc62035-0150-403a-bb80-93bd74c7bfd2 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0420625 Nov 12 15:09:32.865826 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-93468997-30e5-4420-a10c-3ca11e83ed5d service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880544 Nov 12 15:09:32.870195 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:09:32.960066 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ecdb51df-211b-450b-90b5-41f0f42bef92 req-8c56df12-1cb4-43ec-a6ec-4c73a4a68b4f service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868475 Nov 12 15:09:33.101810 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '02e03648-8b21-4bec-ac98-02fab14d15e5', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.249', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:05:58Z', 'updated_at': '2021-11-12T15:06:00Z', 'revision_number': 1, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:33.133299 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80f4b952-4b87-4167-8379-0f0e305b9e07 None None] The sync data for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi is: [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_floatingips': [{'id': '02e03648-8b21-4bec-ac98-02fab14d15e5', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'floating_ip_address': '172.27.3.249', 'floating_network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'router_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'port_id': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'mac_address': 'fa:16:3e:da:b3:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-12T15:05:58Z', 'updated_at': '2021-11-12T15:06:00Z', 'revision_number': 1, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:09:33.350702 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-387fa6f6-854e-417b-a1c6-0c1249fc63d0 None None] New status for floating IP 477405fc-f51c-4567-aee1-0b0ff289245c: DOWN {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:09:33.794782 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea45ad8b-fd45-4065-a388-a2be4134f252 req-1e66e8fe-b135-49f2-93e7-71bfad5da163 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:33.796296 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea45ad8b-fd45-4065-a388-a2be4134f252 req-1e66e8fe-b135-49f2-93e7-71bfad5da163 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 946 time: 0.0502107 Nov 12 15:09:33.849858 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-ea45ad8b-fd45-4065-a388-a2be4134f252 req-21ff1fac-f380-43db-8f93-2e6961e02fd0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0474482 Nov 12 15:09:34.152732 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-eb242259-5bd9-4463-9cba-156d5fbbf02b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:34.154267 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-eb242259-5bd9-4463-9cba-156d5fbbf02b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 946 time: 0.0523584 Nov 12 15:09:34.248585 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Deleting port 1940f60b-82b6-4dfd-857f-e1112c79e735 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:34.248914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:34.341104 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] For port 1940f60b-82b6-4dfd-857f-e1112c79e735, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=1940f60b-82b6-4dfd-857f-e1112c79e735,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:34.341466 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:34.354307 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Calling delete_port for 1940f60b-82b6-4dfd-857f-e1112c79e735 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:34.482650 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:34.513213 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event deleted for resources: {'Port': ['ID=1940f60b-82b6-4dfd-857f-e1112c79e735,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:34.553600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] No DVR routers for this DVR port 1940f60b-82b6-4dfd-857f-e1112c79e735 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:09:34.556092 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:34.559444 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-4a65ebdb-c661-46ab-8187-6bf852be096f req-a9f33f98-c30d-4a45-acf2-0b31854812d5 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "DELETE /v2.0/ports/1940f60b-82b6-4dfd-857f-e1112c79e735 HTTP/1.1" status: 204 len: 173 time: 0.3991160 Nov 12 15:09:34.559883 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'name': 'network-vif-deleted', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:09:34.562289 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-748a6ff6-59bc-4a13-80d2-53c1b56633e2" -d '{"events": [{"server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "name": "network-vif-deleted", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:09:34.603197 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:09:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f168be2c-4266-42f3-b9f4-3355676a822a x-openstack-request-id: req-f168be2c-4266-42f3-b9f4-3355676a822a {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:09:34.603508 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c9451c7-2a78-485f-8fa5-a94283a97792", "name": "network-vif-deleted", "tag": "1940f60b-82b6-4dfd-857f-e1112c79e735", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:09:34.603832 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f168be2c-4266-42f3-b9f4-3355676a822a {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:09:34.604265 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c9451c7-2a78-485f-8fa5-a94283a97792', 'name': 'network-vif-deleted', 'tag': '1940f60b-82b6-4dfd-857f-e1112c79e735', 'status': 'completed', 'code': 200} Nov 12 15:09:34.957041 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-76598180-abcc-4828-b530-79d067e5d577 req-1390125e-4d71-4bc3-8a09-3858b8d6a802 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c9451c7-2a78-485f-8fa5-a94283a97792 HTTP/1.1" status: 200 len: 210 time: 0.0308907 Nov 12 15:09:35.116086 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:38.238914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35602) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:38.397183 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Deleting port 31b8fc36-92f0-41e3-b51f-04fed40d3bbb {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:38.397515 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:38.470460 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:38.470779 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:38.482814 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Calling delete_port for 31b8fc36-92f0-41e3-b51f-04fed40d3bbb owned by network:floatingip {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:38.627194 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:38.652969 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event deleted for resources: {'Port': ['ID=31b8fc36-92f0-41e3-b51f-04fed40d3bbb,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:38.712482 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:38.712825 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.db.l3_db [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Floating IP 02e03648-8b21-4bec-ac98-02fab14d15e5 disassociated (deleted). External IP: 172.27.3.249, port: 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83. Nov 12 15:09:38.912011 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Router 8ec4de9e-dbf9-4aec-bff5-67be839601cd has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:09:39.019407 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:09:39.024019 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:39.033242 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] Sync routers for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:09:39.045299 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:09:39.045923 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:09:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:39.054300 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-54ede3f8-9986-4d66-9be5-c72843828916 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "DELETE /v2.0/floatingips/02e03648-8b21-4bec-ac98-02fab14d15e5 HTTP/1.1" status: 204 len: 168 time: 0.8143051 Nov 12 15:09:39.054893 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:09:39.057227 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-719914f5-05c6-43f1-ad48-c21b301bf342" -d '{"events": [{"name": "network-changed", "server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:09:39.086327 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1940f60b-82b6-4dfd-857f-e1112c79e735 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:09:39.105059 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Fri, 12 Nov 2021 15:09:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-590a49e6-b376-4f84-9ffd-381674982132 x-openstack-request-id: req-590a49e6-b376-4f84-9ffd-381674982132 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:09:39.105347 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:09:39.105600 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-590a49e6-b376-4f84-9ffd-381674982132 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:09:39.106022 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'status': 'completed', 'code': 200} Nov 12 15:09:39.123171 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 1940f60b-82b6-4dfd-857f-e1112c79e735 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:09:39.123508 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 1940f60b-82b6-4dfd-857f-e1112c79e735 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:09:39.168011 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-10a53b1f-0398-43b2-a733-676951ac7a7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:39.169961 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-10a53b1f-0398-43b2-a733-676951ac7a7e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 1098 time: 0.0430191 Nov 12 15:09:39.205211 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:09:39.272935 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-b0d8f241-4118-4823-b593-77ed1ac06a1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:39.274407 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-b0d8f241-4118-4823-b593-77ed1ac06a1d service neutron] 10.222.0.86 "GET /v2.0/networks?id=370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 200 len: 912 time: 0.0950053 Nov 12 15:09:39.296847 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-635ab579-679d-489b-bf73-4bbb5edb348b req-3dd75b19-c8ae-4609-bdcd-ea6ab2e9d9fc tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101617) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:39.298325 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-635ab579-679d-489b-bf73-4bbb5edb348b req-3dd75b19-c8ae-4609-bdcd-ea6ab2e9d9fc tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 945 time: 0.0559740 Nov 12 15:09:39.320868 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-a63c889f-85be-4f23-999d-795b9b959bde service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 HTTP/1.1" status: 200 len: 217 time: 0.0383928 Nov 12 15:09:39.350870 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [req-635ab579-679d-489b-bf73-4bbb5edb348b req-ba241172-5a40-4e31-b853-d5061c00464b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0452166 Nov 12 15:09:39.376645 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-c96f9908-4d51-4cee-a1dd-1d373853a799 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:39.378632 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-c96f9908-4d51-4cee-a1dd-1d373853a799 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 200 len: 850 time: 0.0502653 Nov 12 15:09:39.413877 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:39.426521 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-cc0e0449-bfd9-4ece-af5a-fe5b36b729f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:39.428031 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-cc0e0449-bfd9-4ece-af5a-fe5b36b729f3 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=370662ef-db75-4207-9a43-c725449d1d6d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0409904 Nov 12 15:09:39.441126 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] Checking router: 8ec4de9e-dbf9-4aec-bff5-67be839601cd for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:09:39.450159 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:09:39.450777 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:09:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:39.691904 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:09:39.786717 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-a47af0f0-4018-4e0d-82e0-7ff880d9d14c service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3507974 Nov 12 15:09:39.876338 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-719914f5-05c6-43f1-ad48-c21b301bf342 req-339f8db5-aa70-426c-8c6c-6ced8b5dfbe9 service neutron] 10.222.0.86 "GET /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0821474 Nov 12 15:09:39.890037 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:39.920634 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9444d877-4266-49b6-8ef0-94a1c82f1a38 None None] The sync data for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi is: [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:50Z', 'revision_number': 4, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi', '_interfaces': [{'id': 'e9bba504-b226-44cb-b431-8dd5e4840c85', 'name': '', 'network_id': '370662ef-db75-4207-9a43-c725449d1d6d', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'mac_address': 'fa:16:3e:6a:6b:f5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 564, 'fixed_ips': [{'subnet_id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:49Z', 'updated_at': '2021-11-12T15:02:54Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'subnets': [{'id': '40c8c5f2-e714-4a04-9300-6f56d57e5158', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:09:40.133117 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a792031c-08dd-4be1-8a90-a80b8ad2db0e None None] New status for floating IP 02e03648-8b21-4bec-ac98-02fab14d15e5: DOWN {{(pid=101620) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 12 15:09:40.476713 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-311129ba-65d8-4d1e-9ee2-c270fdf0a171 req-f1eea738-daca-4481-8981-318b6aa86fad tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:40.478273 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-311129ba-65d8-4d1e-9ee2-c270fdf0a171 req-f1eea738-daca-4481-8981-318b6aa86fad tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 945 time: 0.0548925 Nov 12 15:09:40.528616 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-311129ba-65d8-4d1e-9ee2-c270fdf0a171 req-f1f8b152-2874-43d8-bbb5-6894e8970f0b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/security-groups?id=df9b544e-58f6-4924-9387-7a81ef202db0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0444779 Nov 12 15:09:40.863605 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-3ac9d8a5-c04e-432b-921b-a3603c3f1f4b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=101618) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 12 15:09:40.864981 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-3ac9d8a5-c04e-432b-921b-a3603c3f1f4b tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 945 time: 0.0477524 Nov 12 15:09:40.953909 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Deleting port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:40.954240 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:41.045609 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] For port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83, host hv-cinder-77642, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77642',level=0,port_id=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:41.045977 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:41.058773 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Calling delete_port for 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 owned by compute:nova {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:41.191220 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:41.220479 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event deleted for resources: {'Port': ['ID=7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:41.262658 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] No DVR routers for this DVR port 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 on host hv-cinder-77642 {{(pid=101618) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:09:41.265261 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for port, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:41.268964 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-e6bdde34-5379-46ed-82d1-a9db8d3b0f3b req-d3e3f196-4ba2-476d-8437-1646995dd68c tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.86 "DELETE /v2.0/ports/7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 HTTP/1.1" status: 204 len: 173 time: 0.3973777 Nov 12 15:09:41.269396 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'name': 'network-vif-deleted', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83'}] {{(pid=101618) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 12 15:09:41.271644 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4d4aef08086b7e1bc8934e09f8f2b9f8b7369733c9fdaf6d6a6593ed0f41d5ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-24ca59c2-067f-4c15-b36c-4efe016d5fb0" -d '{"events": [{"server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "name": "network-vif-deleted", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83"}]}' {{(pid=101618) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 12 15:09:41.307567 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Fri, 12 Nov 2021 15:09:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de3230b9-d3a1-4722-a0bd-d960617f6ba2 x-openstack-request-id: req-de3230b9-d3a1-4722-a0bd-d960617f6ba2 {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 12 15:09:41.307881 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8", "name": "network-vif-deleted", "tag": "7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83", "status": "completed", "code": 200}]} {{(pid=101618) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 12 15:09:41.308124 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-de3230b9-d3a1-4722-a0bd-d960617f6ba2 {{(pid=101618) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 12 15:09:41.308551 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8', 'name': 'network-vif-deleted', 'tag': '7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83', 'status': 'completed', 'code': 200} Nov 12 15:09:41.650547 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [req-09acbd1b-9080-4878-9fc3-ceef2c2f0961 req-1a580ae6-72af-4eeb-b5fd-1b17e766adc3 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "GET /v2.0/ports?device_id=5e6feb1b-5510-4ca0-a299-c9f7ea5d81e8 HTTP/1.1" status: 200 len: 210 time: 0.0311809 Nov 12 15:09:42.713914 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35618) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:42.843929 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Deleting port 1da483ee-8ee4-4c68-a35c-d47b4d1de7f7 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:42.844301 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:42.924831 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:42.925673 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:42.938553 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Calling delete_port for 1da483ee-8ee4-4c68-a35c-d47b4d1de7f7 owned by network:floatingip {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:43.076403 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:43.100546 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event deleted for resources: {'Port': ['ID=1da483ee-8ee4-4c68-a35c-d47b4d1de7f7,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:43.166864 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for floatingip, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:43.170195 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-2073503'] for floatingip, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:43.171343 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-f95304c7-14fb-4b96-b314-119c80a34068 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "DELETE /v2.0/floatingips/2d4bc9b7-16dd-4477-b896-c37c245c4b3a HTTP/1.1" status: 204 len: 168 time: 0.4564402 Nov 12 15:09:44.356284 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35630) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:44.413727 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-03a76ad0-d855-4e95-b81d-9281ccc10ab0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:44.439145 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-03a76ad0-d855-4e95-b81d-9281ccc10ab0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:44.499101 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-03a76ad0-d855-4e95-b81d-9281ccc10ab0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:44.501898 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-03a76ad0-d855-4e95-b81d-9281ccc10ab0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:44.503102 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-03a76ad0-d855-4e95-b81d-9281ccc10ab0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] 10.222.0.61 "DELETE /v2.0/security-groups/df9b544e-58f6-4924-9387-7a81ef202db0 HTTP/1.1" status: 204 len: 168 time: 0.1458077 Nov 12 15:09:44.513026 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03a76ad0-d855-4e95-b81d-9281ccc10ab0 tempest-TestVolumeBootPattern-736444651 tempest-TestVolumeBootPattern-736444651-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=df9b544e-58f6-4924-9387-7a81ef202db0,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:44.558566 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35634) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:45.045090 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1754847'] for router_interface, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:45.090271 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 no longer exists at agent hyperv_hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:09:45.111073 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] No Port match for: 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:09:45.111410 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Device 7d0a1fa3-3c53-4fe9-a9d4-3f0c9e02aa83 not bound to the agent host hv-cinder-77642 {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:09:45.295409 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Deleting port e9bba504-b226-44cb-b431-8dd5e4840c85 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:45.295644 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:45.374615 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] For port e9bba504-b226-44cb-b431-8dd5e4840c85, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=e9bba504-b226-44cb-b431-8dd5e4840c85,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:45.374975 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:45.387848 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Calling delete_port for e9bba504-b226-44cb-b431-8dd5e4840c85 owned by network:router_interface {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:45.562635 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:45.588154 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Pushing event deleted for resources: {'Port': ['ID=e9bba504-b226-44cb-b431-8dd5e4840c85,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:45.600276 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.600276 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.600575 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.600699 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.600981 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.601309 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.601633 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.601955 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.602269 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.602594 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.602908 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.603224 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101617) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:45.764493 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611175', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1753199'] for router_interface, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:45.986471 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Router 8ec4de9e-dbf9-4aec-bff5-67be839601cd has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101617) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:09:46.326415 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101617) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:09:46.333196 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-9a3d2f5e-c213-4513-9aff-6ac1da9cf2ff admin admin] 10.222.0.61 "PUT /v2.0/routers/8ec4de9e-dbf9-4aec-bff5-67be839601cd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7724965 Nov 12 15:09:46.334357 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35640) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:46.335463 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] Sync routers for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:09:46.345973 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:09:46.347150 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:09:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:46.436667 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks [] for router, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:46.451894 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: dv-cinder-776422-5-iscsi {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:09:46.541561 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:46.595481 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Deleting port 0bc84d78-3052-42c6-b327-391df34810fb {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:46.596161 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:46.637776 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60'}], 'enable_snat': True}, 'gw_port_id': '0bc84d78-3052-42c6-b327-391df34810fb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:09:45Z', 'revision_number': 5, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port': {'id': '0bc84d78-3052-42c6-b327-391df34810fb', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:0f:1a:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 563, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:02:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:46.664924 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] Checking router: 8ec4de9e-dbf9-4aec-bff5-67be839601cd for host: dv-cinder-776422-5-iscsi {{(pid=101619) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:09:46.674158 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] Routers {'8ec4de9e-dbf9-4aec-bff5-67be839601cd'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101619) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:09:46.674830 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:09:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'], 'active': True} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:46.679144 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] For port 0bc84d78-3052-42c6-b327-391df34810fb, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=0bc84d78-3052-42c6-b327-391df34810fb,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:46.679490 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:46.704090 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Calling delete_port for 0bc84d78-3052-42c6-b327-391df34810fb owned by network:router_gateway {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:46.764978 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvr_db [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] Set router 8ec4de9e-dbf9-4aec-bff5-67be839601cd gateway port host: None {{(pid=101619) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:09:46.817790 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_hamode_db [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:09:46Z', 'revision_number': 6, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port_host': None}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101619) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:46.847769 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67a42071-a69f-4182-87cc-5ccb21203648 None None] The sync data for ids ['8ec4de9e-dbf9-4aec-bff5-67be839601cd'] in dv-cinder-776422-5-iscsi is: [{'id': '8ec4de9e-dbf9-4aec-bff5-67be839601cd', 'name': 'tempest-TestVolumeBootPattern-728810930-router', 'tenant_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:47Z', 'updated_at': '2021-11-12T15:09:46Z', 'revision_number': 6, 'project_id': 'e0bd63a24fe9453c84dae6d5536c0df9', 'gw_port_host': None}] {{(pid=101619) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:09:46.876986 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:46.905801 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Pushing event deleted for resources: {'Port': ['ID=0bc84d78-3052-42c6-b327-391df34810fb,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:46.963892 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1760149'] for router_gateway, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.055182 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1755136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-43439'] for router, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.057347 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.102758 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1755257'] for router, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.103124 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8ec4de9e-dbf9-4aec-bff5-67be839601cd {{(pid=101617) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 12 15:09:47.107615 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] Publish callbacks [] for router, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.108816 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-05b7e09b-c2bf-460f-a28d-47acd286c29b admin admin] 10.222.0.61 "DELETE /v2.0/routers/8ec4de9e-dbf9-4aec-bff5-67be839601cd HTTP/1.1" status: 204 len: 168 time: 0.7735345 Nov 12 15:09:47.111293 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35642) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:47.157326 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-137ebcf1-9d1c-4f13-8c47-c418fca74983 admin admin] Deleting subnet 40c8c5f2-e714-4a04-9300-6f56d57e5158 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:09:47.160687 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-137ebcf1-9d1c-4f13-8c47-c418fca74983 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.203586 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-137ebcf1-9d1c-4f13-8c47-c418fca74983 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.288882 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device e9bba504-b226-44cb-b431-8dd5e4840c85 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:09:47.297781 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-137ebcf1-9d1c-4f13-8c47-c418fca74983 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.314283 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: e9bba504-b226-44cb-b431-8dd5e4840c85 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:09:47.314620 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device e9bba504-b226-44cb-b431-8dd5e4840c85 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:09:47.351533 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-137ebcf1-9d1c-4f13-8c47-c418fca74983 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.378677 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-137ebcf1-9d1c-4f13-8c47-c418fca74983 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=40c8c5f2-e714-4a04-9300-6f56d57e5158,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:47.382298 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-137ebcf1-9d1c-4f13-8c47-c418fca74983 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.385643 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-137ebcf1-9d1c-4f13-8c47-c418fca74983 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/40c8c5f2-e714-4a04-9300-6f56d57e5158 HTTP/1.1" status: 204 len: 168 time: 0.2731807 Nov 12 15:09:47.387948 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35644) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:47.388369 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d90d8d44-56cd-4b97-b418-013f43c2604d None None] Network 370662ef-db75-4207-9a43-c725449d1d6d requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:09:47.460098 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.518495 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Deleting port 4058c510-bc73-4949-b7de-e0149222edb8 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:47.518838 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.585394 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] For port 4058c510-bc73-4949-b7de-e0149222edb8, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=4058c510-bc73-4949-b7de-e0149222edb8,segment=NetworkSegment(b5ad6a85-de19-49b7-8ae4-bab83ada0933),segment_id=b5ad6a85-de19-49b7-8ae4-bab83ada0933)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:47.586054 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.599637 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Calling delete_port for 4058c510-bc73-4949-b7de-e0149222edb8 owned by network:dhcp {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:47.651822 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] DHCP port deletion for 370662ef-db75-4207-9a43-c725449d1d6d request from dv-cinder-776422-5-iscsi {{(pid=101619) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 12 15:09:47.690272 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.704626 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Deleting port 4058c510-bc73-4949-b7de-e0149222edb8 {{(pid=101619) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:47.705078 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.719827 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] No DVR routers for this DVR port 4058c510-bc73-4949-b7de-e0149222edb8 on host dv-cinder-776422-5-iscsi {{(pid=101617) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:09:47.724836 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Pushing event deleted for resources: {'Port': ['ID=4058c510-bc73-4949-b7de-e0149222edb8,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:47.777482 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] For port 4058c510-bc73-4949-b7de-e0149222edb8, host dv-cinder-776422-5-iscsi, got binding levels [] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:47.777813 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.791872 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Calling delete_port for 4058c510-bc73-4949-b7de-e0149222edb8 owned by network:dhcp {{(pid=101619) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:47.794732 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.ipam_backend_mixin [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Port 4058c510-bc73-4949-b7de-e0149222edb8 was not found and therefore no delete operation was performed {{(pid=101619) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 12 15:09:47.796328 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.803969 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.819326 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Pushing event deleted for resources: {'Port': ['ID=4058c510-bc73-4949-b7de-e0149222edb8,revision_number=None']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:47.824789 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['370662ef-db75-4207-9a43-c725449d1d6d']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:47.828901 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] No DVR routers for this DVR port 4058c510-bc73-4949-b7de-e0149222edb8 on host dv-cinder-776422-5-iscsi {{(pid=101619) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:09:47.833057 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.833208 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.833497 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.833826 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.839988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.839988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.839988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.839988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.839988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.839988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.839988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.839988 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f5b8b145-e5d7-45fe-9497-625418e391f9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-776422-5-iscsi {{(pid=101619) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 12 15:09:47.844549 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b5ad6a85-de19-49b7-8ae4-bab83ada0933') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:47.844854 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b5ad6a85-de19-49b7-8ae4-bab83ada0933') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:47.856434 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.870266 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.876557 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Releasing vlan 605 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:09:47.876953 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:09:47.878650 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:09:47.933971 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.939652 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:47.943233 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] 10.222.0.61 "DELETE /v2.0/networks/370662ef-db75-4207-9a43-c725449d1d6d HTTP/1.1" status: 204 len: 168 time: 0.5541608 Nov 12 15:09:47.946268 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35646) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:47.957846 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-921cc36d-94b8-4edc-8edc-b80ee66c5901 admin admin] Pushing event deleted for resources: {'Network': ['ID=370662ef-db75-4207-9a43-c725449d1d6d,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:48.299801 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1754847'] for router_interface, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:48.555841 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Deleting port fbed417a-c776-48bd-9e9c-994fd950d141 {{(pid=101618) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:48.556083 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:48.633888 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.db [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] For port fbed417a-c776-48bd-9e9c-994fd950d141, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=fbed417a-c776-48bd-9e9c-994fd950d141,segment=NetworkSegment(b73d2421-3f63-48d8-9968-cd0326575a2e),segment_id=b73d2421-3f63-48d8-9968-cd0326575a2e)] {{(pid=101618) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:48.634242 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:48.647001 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.plugins.ml2.plugin [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Calling delete_port for fbed417a-c776-48bd-9e9c-994fd950d141 owned by network:router_interface {{(pid=101618) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:48.833952 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5822857'] for port, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:48.868288 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Pushing event deleted for resources: {'Port': ['ID=fbed417a-c776-48bd-9e9c-994fd950d141,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:49.038977 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1611175', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1753199'] for router_interface, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:49.142869 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0bc84d78-3052-42c6-b327-391df34810fb no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:09:49.163633 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 0bc84d78-3052-42c6-b327-391df34810fb {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:09:49.163971 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 0bc84d78-3052-42c6-b327-391df34810fb not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:09:49.164422 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 4058c510-bc73-4949-b7de-e0149222edb8 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:09:49.185460 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 4058c510-bc73-4949-b7de-e0149222edb8 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:09:49.185800 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 4058c510-bc73-4949-b7de-e0149222edb8 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:09:49.310662 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Router b6036e8a-2583-46eb-9961-76d9c6b2793c has already been hosted by L3 agent 91196f6e-3f95-4ddc-99d9-d8a4d46bf350 {{(pid=101618) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 12 15:09:49.420202 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] Notify agent at l3_agent.dv-cinder-776422-5-iscsi the message routers_updated {{(pid=101618) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 12 15:09:49.425674 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-cc158a27-8824-47fc-9294-f461a89a4530 admin admin] 10.222.0.61 "PUT /v2.0/routers/b6036e8a-2583-46eb-9961-76d9c6b2793c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4780595 Nov 12 15:09:49.428266 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35648) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:49.432515 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] Sync routers for ids ['b6036e8a-2583-46eb-9961-76d9c6b2793c'] in dv-cinder-776422-5-iscsi {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 12 15:09:49.443072 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] Routers {'b6036e8a-2583-46eb-9961-76d9c6b2793c'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:09:49.443707 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:09:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['b6036e8a-2583-46eb-9961-76d9c6b2793c'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:49.537819 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks [] for router, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:49.551148 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] Set router b6036e8a-2583-46eb-9961-76d9c6b2793c gateway port host: dv-cinder-776422-5-iscsi {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:09:49.645400 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:49.705681 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Deleting port 34a8473e-adc9-4eb2-9c6e-71fa68f754de {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:49.706600 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:49.740616 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'external_fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42'}], 'enable_snat': True}, 'gw_port_id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:09:48Z', 'revision_number': 5, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'gw_port': {'id': '34a8473e-adc9-4eb2-9c6e-71fa68f754de', 'name': '', 'network_id': 'bc8f81a5-42b5-4692-9e4b-bc049497e795', 'tenant_id': '', 'mac_address': 'fa:16:3e:08:03:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 575, 'fixed_ips': [{'subnet_id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'ip_address': '172.27.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-776422-5-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:02:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'f1d69314-a0d5-4375-876e-6ed7c4b8fa75', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-776422-5-iscsi'}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:49.768044 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] Checking router: b6036e8a-2583-46eb-9961-76d9c6b2793c for host: dv-cinder-776422-5-iscsi {{(pid=101620) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 12 15:09:49.777307 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] Routers {'b6036e8a-2583-46eb-9961-76d9c6b2793c'} bound to L3 agent in host dv-cinder-776422-5-iscsi {{(pid=101620) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 12 15:09:49.777961 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-776422-5-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-12T14:46:54Z,description=,heartbeat_timestamp=2021-11-12T15:09:25Z,host='dv-cinder-776422-5-iscsi',id=91196f6e-3f95-4ddc-99d9-d8a4d46bf350,load=0,resource_versions=,resources_synced=,started_at=2021-11-12T14:46:54Z,topic='l3_agent')) {'router_ids': ['b6036e8a-2583-46eb-9961-76d9c6b2793c'], 'active': True} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:49.789205 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] For port 34a8473e-adc9-4eb2-9c6e-71fa68f754de, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=34a8473e-adc9-4eb2-9c6e-71fa68f754de,segment=NetworkSegment(7c3cb67f-9891-4250-9faf-30a0a52f7e95),segment_id=7c3cb67f-9891-4250-9faf-30a0a52f7e95)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:49.789635 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:49.801710 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Calling delete_port for 34a8473e-adc9-4eb2-9c6e-71fa68f754de owned by network:router_gateway {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:49.871559 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_dvr_db [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] Set router b6036e8a-2583-46eb-9961-76d9c6b2793c gateway port host: None {{(pid=101620) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 12 15:09:49.925178 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.l3_hamode_db [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:09:49Z', 'revision_number': 6, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'gw_port_host': None}], 'dv-cinder-776422-5-iscsi', False) {} {{(pid=101620) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:49.955398 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b0533cd-8938-419c-8fe1-9b5eac97b322 None None] The sync data for ids ['b6036e8a-2583-46eb-9961-76d9c6b2793c'] in dv-cinder-776422-5-iscsi is: [{'id': 'b6036e8a-2583-46eb-9961-76d9c6b2793c', 'name': 'tempest-TestVolumeBootPattern-1704084620-router', 'tenant_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-12T15:02:52Z', 'updated_at': '2021-11-12T15:09:49Z', 'revision_number': 6, 'project_id': 'f745c341e1734c63bcdbbeac2e0cb4fd', 'gw_port_host': None}] {{(pid=101620) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 12 15:09:49.977039 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.004254 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Pushing event deleted for resources: {'Port': ['ID=34a8473e-adc9-4eb2-9c6e-71fa68f754de,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:50.066160 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1760149'] for router_gateway, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.154941 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1755136', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-43439'] for router, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.157098 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.200201 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1755257'] for router, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.200733 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Fanout notify agent at l3_agent the message router_deleted on router b6036e8a-2583-46eb-9961-76d9c6b2793c {{(pid=101617) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 12 15:09:50.205029 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] Publish callbacks [] for router, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.206249 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-85b9efd5-7555-4b88-bfb4-3b036f98d2fd admin admin] 10.222.0.61 "DELETE /v2.0/routers/b6036e8a-2583-46eb-9961-76d9c6b2793c HTTP/1.1" status: 204 len: 168 time: 0.7769580 Nov 12 15:09:50.208921 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35650) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:50.260701 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.db_base_plugin_v2 [None req-c77f2bf2-744c-42d7-b533-1fe90d111448 admin admin] Deleting subnet fa62aa41-73bf-425b-8c66-b411b9d45c33 {{(pid=101617) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 12 15:09:50.263795 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c77f2bf2-744c-42d7-b533-1fe90d111448 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.298832 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c77f2bf2-744c-42d7-b533-1fe90d111448 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-7428713'] for subnet, precommit_delete_associations {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.381772 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c77f2bf2-744c-42d7-b533-1fe90d111448 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-669722'] for subnet, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.437599 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c77f2bf2-744c-42d7-b533-1fe90d111448 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-669709', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1828635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-7428647', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5175718'] for subnet, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.467645 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77f2bf2-744c-42d7-b533-1fe90d111448 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fa62aa41-73bf-425b-8c66-b411b9d45c33,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:50.471276 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-c77f2bf2-744c-42d7-b533-1fe90d111448 admin admin] Publish callbacks [] for subnet, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.484089 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-c77f2bf2-744c-42d7-b533-1fe90d111448 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/fa62aa41-73bf-425b-8c66-b411b9d45c33 HTTP/1.1" status: 204 len: 168 time: 0.2649906 Nov 12 15:09:50.484089 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [-] (101617) accepted ('10.222.0.61', 35652) {{(pid=101617) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:50.484793 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96719b07-4174-4e31-b671-517dac8e98e1 None None] Network 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 requested from dv-cinder-776422-5-iscsi {{(pid=101619) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 12 15:09:50.550502 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1404543'] for network, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.632477 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Deleting port de16a396-d483-4270-a3d0-701ff978fa77 {{(pid=101617) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:50.632897 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.704709 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.db [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] For port de16a396-d483-4270-a3d0-701ff978fa77, host dv-cinder-776422-5-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-776422-5-iscsi',level=0,port_id=de16a396-d483-4270-a3d0-701ff978fa77,segment=NetworkSegment(b73d2421-3f63-48d8-9968-cd0326575a2e),segment_id=b73d2421-3f63-48d8-9968-cd0326575a2e)] {{(pid=101617) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:50.705069 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.719996 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.plugin [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Calling delete_port for de16a396-d483-4270-a3d0-701ff978fa77 owned by network:dhcp {{(pid=101617) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:50.766516 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] DHCP port deletion for 9d4ba502-25f4-4402-adc5-0da53ae8c6f3 request from dv-cinder-776422-5-iscsi {{(pid=101619) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 12 15:09:50.802987 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-7428628'] for port, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.825191 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] Deleting port de16a396-d483-4270-a3d0-701ff978fa77 {{(pid=101619) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 12 15:09:50.825796 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8744642589624'] for port, before_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.833154 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Pushing event deleted for resources: {'Port': ['ID=de16a396-d483-4270-a3d0-701ff978fa77,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:50.836747 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.db.l3_dvrscheduler_db [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] No DVR routers for this DVR port de16a396-d483-4270-a3d0-701ff978fa77 on host dv-cinder-776422-5-iscsi {{(pid=101617) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:09:50.889933 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.db [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] For port de16a396-d483-4270-a3d0-701ff978fa77, host dv-cinder-776422-5-iscsi, got binding levels [] {{(pid=101619) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 12 15:09:50.890319 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1747065'] for port, precommit_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.903206 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] Calling delete_port for de16a396-d483-4270-a3d0-701ff978fa77 owned by network:dhcp {{(pid=101619) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 12 15:09:50.905990 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.ipam_backend_mixin [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] Port de16a396-d483-4270-a3d0-701ff978fa77 was not found and therefore no delete operation was performed {{(pid=101619) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 12 15:09:50.907296 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-561349', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2022025', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8744642596482', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8744642121117'] for port, after_delete {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.911072 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-671133', 'neutron.services.segments.db._delete_segments_for_network-8744642552302'] for network, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.933329 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] Pushing event deleted for resources: {'Port': ['ID=de16a396-d483-4270-a3d0-701ff978fa77,revision_number=None']} {{(pid=101619) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:50.933599 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9d4ba502-25f4-4402-adc5-0da53ae8c6f3']}} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:50.935166 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99013980-ff79-4602-b798-0e10e83f7979 None None] No DVR routers for this DVR port de16a396-d483-4270-a3d0-701ff978fa77 on host dv-cinder-776422-5-iscsi {{(pid=101619) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 12 15:09:50.947162 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b73d2421-3f63-48d8-9968-cd0326575a2e') {'for_net_delete': True} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:50.947456 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.services.segments.db [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b73d2421-3f63-48d8-9968-cd0326575a2e') {} {{(pid=101617) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 12 15:09:50.957814 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8744642657015', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-7423130'] for segment, before_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.977608 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973'] for segment, precommit_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.986989 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Releasing vlan 618 on physical network physnet1 to pool {{(pid=101617) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 12 15:09:50.987494 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-683973', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-7428681'] for segment, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: Traceback (most recent call last): Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: timer() Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: cb(*args, **kw) Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: return func(*args, **kwargs) Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: self._notify() Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: self.callback(batched_events) Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: event.method(event) Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: aggregate_uuid = self.p_client.list_aggregates( Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: return f(self, *a, **k) Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._get(url).json() Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: return self.request(url, 'GET', **kwargs) Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: base_url = self.get_endpoint(auth, allow=allow, Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 12 15:09:50.989250 dv-cinder-776422-5-iscsi neutron-server[101617]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 12 15:09:51.070425 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-671108', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1805341', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1611182', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1760233'] for network, after_delete {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.076249 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron_lib.callbacks.manager [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1611192'] for network, before_response {{(pid=101617) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.082766 dv-cinder-776422-5-iscsi neutron-server[101617]: INFO neutron.wsgi [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] 10.222.0.61 "DELETE /v2.0/networks/9d4ba502-25f4-4402-adc5-0da53ae8c6f3 HTTP/1.1" status: 204 len: 168 time: 0.6017213 Nov 12 15:09:51.093826 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-528b1483-a294-4379-9786-796b1812d3db admin admin] Pushing event deleted for resources: {'Network': ['ID=9d4ba502-25f4-4402-adc5-0da53ae8c6f3,revision_number=None']} {{(pid=101617) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:51.094497 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device fbed417a-c776-48bd-9e9c-994fd950d141 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:09:51.121907 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: fbed417a-c776-48bd-9e9c-994fd950d141 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:09:51.122253 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device fbed417a-c776-48bd-9e9c-994fd950d141 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:09:51.122883 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device de16a396-d483-4270-a3d0-701ff978fa77 no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:09:51.146530 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: de16a396-d483-4270-a3d0-701ff978fa77 {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:09:51.146879 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device de16a396-d483-4270-a3d0-701ff978fa77 not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:09:51.147298 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 34a8473e-adc9-4eb2-9c6e-71fa68f754de no longer exists at agent ovs-agent-dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 12 15:09:51.169263 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.plugin [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] No Port match for: 34a8473e-adc9-4eb2-9c6e-71fa68f754de {{(pid=101619) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 12 15:09:51.170120 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron.plugins.ml2.rpc [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Device 34a8473e-adc9-4eb2-9c6e-71fa68f754de not bound to the agent host dv-cinder-776422-5-iscsi {{(pid=101619) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 12 15:09:51.218980 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35656) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:51.264022 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-846a8fe2-4433-4127-ac5e-6cbfa197016f admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e0bd63a24fe9453c84dae6d5536c0df9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0437796 Nov 12 15:09:51.267148 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35658) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:51.317351 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9be1e115-cbe4-4c6b-a56c-5e8d285d0e30 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.340000 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9be1e115-cbe4-4c6b-a56c-5e8d285d0e30 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.385798 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9be1e115-cbe4-4c6b-a56c-5e8d285d0e30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.388754 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-9be1e115-cbe4-4c6b-a56c-5e8d285d0e30 admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.390017 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-9be1e115-cbe4-4c6b-a56c-5e8d285d0e30 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/0dd76a6a-423d-4052-8203-56dcfdc1e9dd HTTP/1.1" status: 204 len: 168 time: 0.1219468 Nov 12 15:09:51.399157 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be1e115-cbe4-4c6b-a56c-5e8d285d0e30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0dd76a6a-423d-4052-8203-56dcfdc1e9dd,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:51.719994 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35664) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:51.764579 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-19f2d4dd-0f10-4db8-962f-8185df4395da admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=f745c341e1734c63bcdbbeac2e0cb4fd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0432334 Nov 12 15:09:51.767382 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.wsgi [-] (101618) accepted ('10.222.0.61', 35666) {{(pid=101618) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 12 15:09:51.821970 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ce5e141f-32b5-41ff-a29f-efec60df6fbc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.843732 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ce5e141f-32b5-41ff-a29f-efec60df6fbc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.893059 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ce5e141f-32b5-41ff-a29f-efec60df6fbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1803473'] for security_group, after_delete {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.896092 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron_lib.callbacks.manager [None req-ce5e141f-32b5-41ff-a29f-efec60df6fbc admin admin] Publish callbacks [] for security_group, before_response {{(pid=101618) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:51.897983 dv-cinder-776422-5-iscsi neutron-server[101618]: INFO neutron.wsgi [None req-ce5e141f-32b5-41ff-a29f-efec60df6fbc admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/2fa7fcc7-eb7f-46eb-902e-a378c2f8a70b HTTP/1.1" status: 204 len: 168 time: 0.1296282 Nov 12 15:09:51.907719 dv-cinder-776422-5-iscsi neutron-server[101618]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5e141f-32b5-41ff-a29f-efec60df6fbc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fa7fcc7-eb7f-46eb-902e-a378c2f8a70b,revision_number=None']} {{(pid=101618) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 12 15:09:52.126388 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c1ddd2a3-eff0-4dd5-93a3-938799ff20c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:54.571556 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-fb10e6b9-252c-4f6a-a64d-d9140155dab7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:55.591514 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:56.999714 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:09:57.950542 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:05.133537 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:08.339409 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:10:22.131082 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-dc0ef5e4-04b2-4463-8349-ced08f1ae858 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:24.576761 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-975099da-a227-4878-bb52-603ce1d0d8dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:24.754875 dv-cinder-776422-5-iscsi neutron-server[101617]: DEBUG neutron.wsgi [req-1067bb66-581b-4b77-9364-beda926bd390 req-09ed9346-9e44-4dc6-a6f5-b23d3571989a service neutron] (101617) timed out ('10.222.0.86', 53852) {{(pid=101617) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 12 15:10:25.596484 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:27.003538 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:27.954931 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:35.145335 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:45.337802 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:10:52.133471 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-afead010-a1e0-468e-bb02-5d3e2c1dbef5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:54.578499 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-dd0e59b1-8771-4dcf-b65a-6edbb394e207 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:55.596485 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:57.006331 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:10:57.958915 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:05.144068 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:22.135174 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-244003bb-599c-41bb-a51b-0c414d8f72f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:22.335950 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:11:24.583608 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-a0acf3ba-da78-452c-978d-6cab3d1921ea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:25.718132 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:27.009067 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:27.960990 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:35.158198 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:52.136733 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6e1075b8-190b-4448-ae81-04b67485fc7a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:54.584695 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-c972d6e1-ab40-4b3c-b19b-f0840f6be9ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:55.601716 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:57.012691 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:57.963196 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:11:59.334574 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:12:05.161393 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:22.138238 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-69f2453e-034c-4126-983d-a7bcb7749813 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:24.588586 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7a6e5ec2-ddd4-44c6-bba7-42f2366a63e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:25.605104 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:27.016343 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:27.965666 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:35.173332 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:36.332810 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:12:52.140807 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-cb5593f6-f697-4bce-adb2-82a9018f5adb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:54.590916 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-78f0227a-12fd-4411-a0c2-0cc422f82be8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:55.606983 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:57.015170 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:12:57.968425 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:05.187964 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:13.331203 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:13:22.143275 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-60977825-7560-4103-a4b2-0c3c5410b58f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:24.594977 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-3fcaf353-6e80-4759-b7b7-384cf6816dd0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:25.610950 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:27.018801 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:27.969905 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:35.187282 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:50.329952 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:13:52.145452 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-22a7f6e2-612d-4a4e-829c-5c4dc2ed14b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:54.601939 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-0f27463a-6f8f-4ffc-946c-ceb7ec785b0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:55.615623 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:57.020745 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:13:57.971450 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:05.184538 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:22.146839 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-dab2866a-fb01-4ae7-acb6-6791c62f5b80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:24.594697 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-e75bd7e1-4207-4356-b773-8ad3e02618b9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:25.616305 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:27.024679 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:27.331784 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 12 15:14:27.973953 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:35.183629 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-93ec9ca2-48ca-4927-8c47-2638a2f55366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:52.148026 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-5f75edf3-b868-4f24-a8fc-f8387c77e56b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:54.595055 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6fe50e13-90fe-49c4-adcd-0889184684d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:55.618926 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-7d0041e3-2121-49eb-8ba8-7801d802f641 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:57.027273 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-906a4136-546c-454b-8332-38c74c8e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:14:57.976693 dv-cinder-776422-5-iscsi neutron-server[101619]: DEBUG neutron_lib.callbacks.manager [None req-6120a9e1-0ce5-492b-a712-2d1ee52115a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8744642552284', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-658011'] for agent, after_update {{(pid=101619) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 12 15:15:04.331800 dv-cinder-776422-5-iscsi neutron-server[101620]: DEBUG neutron.db.agents_db [None req-0f133941-3b44-4896-8922-d8a9da96dcc9 None None] Agent healthcheck: found 6 active agents {{(pid=101620) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}